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Preface 



The theory of stochastic processes originally grew out of efforts to describe 
Brownian motion quantitatively. Today it provides a huge arsenal of methods 
suitable for analyzing the influence of noise on a wide range of systems. The 
credit for acquiring all the deep insights and powerful methods is due main- 
ly to a handful of physicists and mathematicians: Einstein, Smoluchowski, 
Langevin, Wiener, Stratonovich, etc. Hence it is no surprise that until re- 
cently the bulk of basic and applied stochastic research was devoted to purely 
mathematical and physical questions. 

However, in the last decade we have witnessed an enormous growth of 
results achieved in other sciences - especially chemistry and biology - based 
on applying methods of stochastic processes. One reason for this stochastics 
boom may be that the realization that noise plays a constructive rather than 
the expected deteriorating role has spread to communities beyond physics. 

Besides their aesthetic appeal these noise-induced, noise-supported or 
noise-enhanced effects sometimes offer an explanation for so far open prob- 
lems (information transmission in the nervous system and information pro- 
cessing in the brain, processes at the cell level, enzymatic reactions, etc.). 
They may also pave the way to novel technological applications (noise-en- 
hanced reaction rates, noise-induced transport and separation on the nano- 
scale, etc.). Key words to be mentioned in this context are stochastic res- 
onance, Brownian motors or ratchets, and noise-supported phenomena in 
excitable systems. 

A second important field where noise can play an eminent role are phe- 
nomena of structure formation. Spirals, fronts, kinks, interfaces, domains, 
growing surfaces, etc., usually modeled theoretically by physicists, are impor- 
tant for many real phenomena in physics, chemistry and biology, e.g. current 
filaments in semiconductors, catalytic reactions on surfaces, and the complex 
dynamics of the heart, of the brain, or of ecosystems. 

It is an amusing fact of history that the theory of stochastic processes 
was initiated in 1828 by Robert Brown’s observation of the irregular motion 
of pollen grains suspended in water. As a botanist - which is more akin to a 
biologist than to a physicist - he was inclined to explain his observation by en- 
dowing the pollen grains with a vital force, the molecules of life. Actually, his 
biologically inspired idea has been revived recently by physicists opening the 
research field of active Brownian particles. Later, Brown convinced himself - 
and others - that tiny particles of inorganic substances were also subjected 
to the same motion. As a consequence, Brownian motion soon drifted from 
biology to physics where Einstein (1905) and Smoluchowski (1906) published 
theories, which proved to be a first major breakthrough. From this perspective 
it is interesting to see that stochastic processes and Brownian motion have 
made their way from biology to physics to chemistry and back to biology. 




VI 



Preface 



The present book is a collection of short articles, which together reflect 
and describe the fields in which applied stochastics is currently most fruitful 
and promising. Many of the authors are renowned experts in today’s hot top- 
ics and have strongly influenced their own research fields. The presentation 
is intended to be pedagogical and self-contained. To achieve this, each article 
went through a refereeing process. The book will thus be accessible to gradu- 
ate students; but also scientists active in one of the fields - or contemplating 
entering a new field - should find much useful material reflecting the state of 
the art. 
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Foreword: 

Lutz Schimansky-Geier: 

The Earlier and the Later Years 



Prank Moss 

Deapartment of Physics, Center for Neurodynamics, University of Missouri at 
St.Louis, Saint-Louis, Missouri 63121, USA 



SToxctariKoa - its root, crroxocr, means variously “arrow”, “aim” or “ob- 
jective” , but already the ancient Greeks realized that hitting or missing the 
target was a chance process - dependent on the whim of the Gods - and 
hence it took on the implication of randomness. In the early days of radio, 
the random arrival of electrons at the anode of a vacuum tube caused a hiss- 
ing sound in loud speakers which the engineers called “noise” . Thus “Applied 
Stochastic Processes” are that class of phenomenon which involve noise as an 
essential ingredient, either to the inherent effectiveness of the process or to its 
fundamental understanding. To those early engineers - and indeed to many 
even today, having absorbed linear transform theory with their mother’s milk 

- noise was (is) an unavoidable nuisemce, greatly to be despised, always to 
be minimized and at all cost! But in spite of this mind-set a modern field 
involving basic studies of stochastic processes in diverse nonlinear systems 
has grown vigorous, attractive and influential. 

Today the field of nonlinear stochastic processes is vigorous and produc- 
tive. It combines the more traditional aspects of classical and quantum statis- 
tical mechanics with the newer field of deterministic, nonlinear dynamics. The 
latter field gave birth to chaos theory that has impacted virtually every area 
of scientific research from mechanics and engineering through astrophysics to 
biology and medicine. More recently, studies of high-dimensional stochastic 
processes in combination with low-dimensional, deterministic dynamics have 
become important. This is true especially in biology and medicine, where 
noise is ubiquitous, and where the detection of low-dimensional processes 
buried within the noise, for example, in the control of chaos, have become 
important. Thus today we observe vigorous and dynamic research activity in 
areas wherein Lutz Schimansky-Geier [LSG] made fundamental contributions 
already nearly 2 decades ago. 

As with all fields, its robust health today owes everything to a few early 
pioneers: those who put forth clear theories gleaned from studies on paradig- 
matic systems. In our field, the paradigmatic system is the bistable potential 

- the so-called “standard quartic” - and LSG easily qualifies as an early 
pioneer with his book. Noise and Diffusion in Bistable Nonequilibrium Sys- 
tems, published together with a colleague, H. Malchow, in 1986 by Teubner. 
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Today, our field is characterized by three descriptors: nonlinear, nonequilib- 
rium^ and dynamical, and one can discern all three as major influences in 
the aforementioned early book. So we began to study how bistable dynamical 
systems respond to noise first in the overdamped limit and later, alas with 
appropriate approximations, how underdamped, or inertial systems dynami- 
cally evolve. LSG was in the thick of this, with a series of papers commencing 
in the very early 1980’s published initially with his mentor, Prof. Dr. Werner 
Ebeling. Especially notable were early studies on noisy biochemical oscil- 
lators as well as the effects of noise on the propagation of wave fronts in 
excitable media, topics which years later were destined to become “hot” in 
the general community of nonlinear scientists^. The late 80’s saw Lutz con- 
tinuing to make fundamental studies of spatio-temporal dynamics with noise, 
for example in the Belousov- Zhabotinski chemical reaction and at the same 
time opening up the door to studies of the so called “colored” noise in non- 
linear systems. Soon after, he made seminal studies of “harmonic noise”, or 
noise with a preferred frequency. Harmonic noise is useful even today in quite 
practical studies, sometimes for odd or unforeseen applications, for example, 
of the strange electrical signatures of certain zooplankton upon which even 
stranger fish feed by exclusive means of an electrical sense. The early-to-mid 
90s saw Lutz turn his attention to stochastic resonance with a seminal series 
of papers wherein the phenomenon was exhibited and studied in a variety 
of unique and novel systems with current applications in both physics and 
biology. These studies included original applications of stochastic resonance 
to spatio-temporal systems. Today he is triggering new theories of stochastic 
resonance using modern information theoretic techniques, studies that will 
soon- be applied in sensory biology. “Applied” is a key adjective. LSG is the 
Director of the Laboratory for Applied Stochastic Processes, a position from 
which he exerts a strong, stimulating influence on contemporary research in 
stochastics, informatics and nonlinear dynamics. 

The aforementioned topics are only a bare smattering of the topical areas 
to which LSG has made fundamental contributions. He is thus widely known 
and highly esteemed by his colleagues and well-wishers the world over. Suffice 
it to look at the list of distinguished contributors to this volume in order to be 
convinced of the novelty, interest and impact of LSG’s work over the past two 
and one-half some decades. And we can easily discern his influence extending 
over this time in the titles that comprise this volume, ranging as they do from 
stochastic resonance through noisy excitable systems. Brownian motion, to 

^ Having grown bored with treatises on linear systems in thermodynamic equilib- 
rium, we seem to have adopted the rather unimaginative propensity to describe 
our main interests with non- words, delineating that in which we are definitely 
not interested in rather than troubling to identify that in which we are. 

^ Indeed, it took biologists and neuroscientists at least a decade and a half more 
(until the mid-to-late 90’s) to begin to appreciate that noise - they insist on 
calling it “variability” - mediates many of the very processes of greatest interest 
in neurodynamics. 
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reaction-diffusion systems and structure formation; all topical areas to which 
Lutz has contributed. 

We wish him well on his 50*^ birthday and we look forward to an ensuing 
two or three more decades of inspiring and fundamental research. 




Directed Current Without Dissipation: 
Reincarnation of a Maxwell-Loschmidt Demon 



Igor Goychuk and Peter Hanggi 

Theoretische Physik I, Institut fiir Physik, Universitat Augsburg, 
D - 86135 Augsburg, Germany 



Abstract. We investigate whether for initially localized particles a directed current 
in rocked periodic structures is possible in absence of a dissipative mechanism. With 
a pure Hamiltonian dynamics the breaking of Time-Reversal-Invariance presents a 
necessary condition to find nonzero current values. Numerical studies are presented 
for the classical Hamiltonian dynamical case. These support the fact that indeed 
a finite current does occur when a time-reversal symmetry-breaking signal, such 
as a harmonic mixing signal, is acting. To gain analytical insight we consider the 
coherent driven quantum transport in a one-dimensional tight-binding lattice. Here, 
a finite coherent current is absent for initially localized preparations; it emerges, 
however, when the initial preparation (with zero initial current) possesses finite 
coherence. The presence of phase fluctuations will eventually kill any finite current, 
thereby rendering the nondissipative currents a transient phenomenon. 



1 Introduction 

Is it possible to get work out of fluctuations? The answer is a definite “yes” . 
This fact is evident from the daily experience with the functioning of mechan- 
ical and electrical rectifiers. A typical realization refers to the self-winding 
wristwatch that works especially well with gesticulating carriers. It must be 
stressed, however, that all these examples refer to macroscopic fluctuations. 
The issue becomes more subtle if microscopic fluctuations of classical or quan- 
tum Brownian nature are involved. In presence of dissipation, this area of 
research has been in the limelight over recent years, and it enjoys an ever 
increasing activity. It is known under the label of Brownian motors, ratchet 
devices, and in a biological context it is referred to as molecular motors; for 
recent reviews see the items [1-4]. The issue we want to address with this 
communication is the problem whether such directed transport in periodic 
structures can occur if no (!) dissipation is acting on the system. The obvi- 
ous answer is again an “of course”: A ballistic, nondissipative particle with 
nonzero initial velocity can traverse a periodic structure at no risk. The ob- 
jective is more tenuous, however, if we define the generation of fluctuation - 
induced directed current only for the situation that initially the particles are 
put into the system with zero velocity. 

With this prerequisite, a resulting nonvanishing current is indeed counter- 
intuitive: It reflects the fact that directed current is obtained out of fluctua- 



J.A. Freund and T. Poschel (Eds.): LNP 557, pp. 7-20, 2000. 
(c) Springer- Verlag Berlin Heidelberg 2000 
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tions in absence of a dissipative mechanism. (Note that persistent ring cur- 
rents - yielding magnetization - are compatible with thermal equlibrium.) 
Such a result may be interpreted as a gain of information that in principle 
can be thought of being put into use for a reduction of thermodynamic en- 
tropy. This in turn brings back to our minds the thought construction of 
a Maxwell’s demon. Such a demon was introduced to a public audience by 
James Clerk Maxwell in his 1871 book Theory of Heat [5] with the goal to 
“pick a hole in the second law”. In summary, this demon refers to a hypo- 
thetical being or device of arbitrarily small mass that possesses for all times 
the complete information on all positions and velocities of the molecules in a 
vessel which is divided into two parts A and B. These two parts are connected 
by a small hole. He can see the individual molecules. Then, without wasting 
work, he opens and closes this hole so as to allow only the swifter ones to 
pass from A to B, and only the slower ones to pass from B to A. In doing so, 
a pressure is build up without having done work, being in violation with the 
second law of thermodynamics. This idea actually has also been formulated 
by a colleague of Ludwig Boltzmann, namely Josef Loschmidt in 1869 [6]. 
We note that in thermodynamics, high-ordered energy can degrade sponta- 
neously into a disordered form, termed heat. The everyday experience shows 
that the time-reversed process seems not to occur naturally. More technically, 
the second law of thermodynamics states that the total entropy of a closed 
system cannot decrease. Irreversible transport then necessarily requires an 
arrow of time - causing dissipation i.e. the second law (if such a law ac- 
tually is applicable away from thermal equilibrium) determines the direction 
of natural processes in a system. 

Directed transport is thus generally thought of as being possible only in 
presence of irreversibility causing some sort of dissipation. Most sucesseful 
theories such as the Boltzmann transport theory (Stosszahlansatz), the the- 
ory of stochastic processes being reflected in the schemes of Fokker-Planck 
equations or master equations, or also in the approaches that formally start 
from the Liouville equation and use a closure procedure and/or introduce a 
time direction via the choice of initial condition, such as the fully uncorrelated 
many-particle distribution in Bogoliubov’s theory, all involve an element of 
Time-Reversal Non-Invariance. It was also the symmetry of Time-Reversal 
of the autonomous Liouville equation - causing (on a finite time scale) anti- 
kinetic behavior by reversing all the velocities - that led Loschmidt [7] to 
his famous objection to Boltzmann’s H-theorem, known as the Loschmidt 
paradox. This paradox should not be confused with Zermelo’s paradox [8]; 
the latter objection to Boltzmann’s kinetic theory is formulated in the form 
of a (Poincare) recurrence paradox. 

Our prime challenge here is as follows: Is it possible that a deterministic 
Hamiltonian dynamics alone - with no reference to the concept of dissipation 
- is able to support a directed current? If the answer is yes, we in essence (on 
the level of few-degrees Hamiltonian chaos) deal with a re-incarnation of the 
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brainchild created by Maxwell and Loschmidt, namely finite directed trans- 
port (carrying information) starting out from zero occurs without dissipation. 
The fact that this is - in principle allowed - lies hidden in the Loschmidt para- 
dox: What happens when we break Time-Reversal-Symmetry in a purely de- 
terministic Hamiltonian dynamics? Before addressing this situation we first 
recall the deterministic dissipative case. 

2 Periodically Rocked Deterministic Ratchets 

2.1 Rocking Ratchets in Presence of Dissipation 

By now it is well known that directed transport can occur on a pure dissipa- 
tive, deterministic level. The deterministically rocked overdamped dynamics 
in a ratchet potential, i.e. a periodic potential profile that breaks the spa- 
tial reflection-symmetry, has been studied in Refs. [9-11]. There exist many 
macroscopic devices that allow directed transport by use of a periodic rock- 
ing force. The situation is typified by the deterministic, overdamped ratchet 
dynamics 

X = — -b ylcos(£U<) (1) 

ax 

with the ratchet potential from Ref. [11] given explicitly by 

Ur{x) = — ;i^[sin(27rx) + ^sin(47rx)] (2) 

27T 4 

Given the simple one-dimensional non-autonomous first order differential 
equation the resulting current behavior is rather rich, exhibiting co-existing 
stable periodic solutions x{t), current quantization phenomena [11] and a 
devil staircase behavior for the current itself [10,11]. In particular, in this 
case of overdamped motion no deterministic current reversal occurs. The 
latter happens only in presence of noise within the non-adiabatic driving 
regime [11], note also the contribution by Reimann in this volume. In Figure 
1 we depict this complex phase-diagram for the current behavior as a function 
of driving frequency u and driving amplitude A. 

The influence of finite inertia with ax- contribution occurring in Eq.(l) 
has been studied in Ref. [13], and recently in Ref. [14]. Now the current 
behavior is even richer, exhibiting multiple deterministic current reversals, 
current carrying solutions in the regular regime and chaotic regime as well, 
an universal Gaussian scaling regime [13], intermittent chaotic behavior and 
anomalous deterministic diffusion [13, 14]. Note, however, that the dissipative 
term proportional to x breaks Time-Reversal Symmetry. Finite dissipation 
thus generically yields a stationary current in an extended parameter regime 
of driving strength, driving frequency, and mass value. As noted already in 
Ref. [13], see footnote [16] therein, this very form of a driven inertial dynamics 
in absence of dissipation is now invariant under Time Reversal Symmetry 
t — > —t: as a consequence, the absence of the x — term allows for zero 
current throughout the whole parameter regime. 
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CO 



Fig. 1. Phase diagram for finite directed current (white areas) and zero current 
(black areas) for the overdamped periodically rocked ratchet dynamics in (1), in 
the potential (2), as a function of dimensionless amplitude strength A and di- 
mensionless driving frequency ui. Note that the onset of current with increasing 
driving frequency requires an increased amplitude strength over the adiabatic limit 
A = 0.75. This figure has originally been provided by Peter Talkner et al. in (1995) 
[ 12 ]. 

2.2 Directed Transport in Absence of Dissipation 

We next take a closer look at an inertial Hamiltonian dynamics in a periodic 
potential U{x) = U{x + a) which is subject to a time-periodic, on average 
unbiased forcing F{t+T) = F{t). The time-dependent Hamiltonian dynamics 
for a particle of mass m in scaled units thus reads 

mx - • (3) 

We shall define the mean velocity v of this driven Hamiltonian dynamics by 
considering (with i(0) = 0) the limiting procedure 

V = lim v(t) = . (4) 

t—>oo t ^ ' 

For Eq.(4) to make sense, we implicitly assume here a self-averaging be- 
havior for the current. By merely glancing at Figure 2, which exhibits the 
tilted potential profile at a maximal forward and backward tilt, one naively 
conceives that the condition of breaking the reflection symmetry (a ratchet 
profile) should suffice to induce a directed current for symmetric rocking 
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F{t) = El cos{u}t). As already noted above, however, this inertial dynamics 
satisfies the Time - Reversal Symmetry, t — > —t + to, with to in general 
being a nonvanishing constant. In our case of a pure cos - drive this constant 
is zero. Recently, Flach and collaborators [15] realized that the introduction 
of a broken time-space symmetry can indeed yield nonzero directed current. 
In particular, they considered the case of a harmonic mixing drive, see [16] , 
consisting of two harmonics with commensurate frequencies at w and 2u), i.e. 

F{t) = El cos[o;t + V’(^)] + cos[2wt -t- 2^(t) -t- </>], (5) 

where <p denotes a fixed relative phase between the harmonics. Flach et al. 
[15] considered the case with set identically to zero. 




Fig. 2. Sketch of the untilted and (left and right) maximally tilted ratchet potential 
configurations for the scaled Hamiltonian dynamics x = —j^Ur{x) + 5cos(t) with 
Ur{x) = — sin(27ra:) — 0.2 sin(47ra;). 



For later purposes, we allow in general, however, for realistic locked fluc- 
tuations of the absolute phases of the two harmonics. These nonzero phase 
fluctuations do reflect the fact that under realistic conditions the quality of 
coherent sources is never perfect, so that the case ip{t) =0 must be considered 
as a (mathematical) idealization. Nevertheless, we shall defer the impact of 
such finite phase fluctuations to section 3.2 below and consider first the ideal 
situation. As noted by Flach and collaborators, this harmonic mixing signal 
F{t) yields Time-Reversal-Non-Invariance for the Hamiltonian dynamics in 
(3). Our numerical findings for the time evolution of the position x{t) and the 
mean velocity, or current, are depicted with Figures 3(a) and 3(b). Care must 
be involved in integrating the Hamiltonian dynamics so as not to introduce a 
spurious dissipation induced by the numerical scheme. In doing so, we have 
employed a symplectic integrator [17], which guarantees the conservation of 
phase volume. 
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Fig. 3. Position (a) and mean velocity (b) of a particle in the ratchet potential 
Ur{x) = — sin(27r2;)— 0.2 sin(47ra:) driven by the harmonic mixing force (5) with unit 
frequency cj = 1. The particle is initially localized at the bottom of the potential well 
near a: = 0, and starts out with zero velocity. The strength of the first harmonic in 
(5) was fixed, E\ = 5, which just corresponds to the situation depicted in Fig. 2. The 
strength of the second harmonic is chosen either zero, or E 2 = 2. Moreover, we use 
rp{t) 0, and the relative phase <p is chosen either zero, or tt/ 2. The numerics were 
performed according to the leapfrog/ Verlet algorithm, cf. Eq. (6), with the time 
step At = 2n/6 x 10“®, or smaller. When the time reversal symmetry is unbroken, 
i.e. E 2 = 0 or E 2 ^ 0, but 0 = 0, no mean velocity emerges. However, the particle 
experiences large, Levy-flight like excursions (cf. inset in Fig. 3a). Moreover, the 
mean velocity itself undergoes zero-mean random fluctuations (cf. inset in Fig. 3b) . 
The Time-Reversal-Non-Invariance of the dynamics yields nonzero current. 
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In practice, we have used the symplectic integrator given by the leap- 
frog/Verlet scheme: 



^n+1 = ^n + \ V UniXn) ~ F{tn) 

m 2 L 

Pn+l ~ Pn 2^^ ^ "b -^(^n) -f^(^n+l) 



( 6 ) 



We thus find that the breaking of Time-Reversal Invariance presents the key 
to obtain possible finite, rocking induced directed current. The breaking of 
reflection symmetry is not important for this result; a finite current appears 
as well for a reflection - symmetric potential when driven by a harmonic mix- 
ing signal. We further note that the trajectories x{t), as well as the current 
v{t), exhibit some intermittent, Levy-flight [18] like diffusive behavior. There- 
fore, we suspect that the x-motion and the velocity, eq. (4), are not strictly 
self-averaging, but presumably (no strong super-diffusion) exhibit long-time 
fluctuations that decay for the velocity variable as f -l oo. Moreover, the 
condition of Time- Reversal- Non-invariance is only necessary (but not suffi- 
cient; see Eq. (12) below) to induce a finite current. With the relative phase 
set at </> = 0 one regains Time-Reversal Symmetry, yielding again a zero 
current as depicted in Fig. 3 (a) and 3 (b), note the dashed line behavior 
therein. We conjecture here, that the slightest amount of absolute phase fluc- 
tuations ip{t) ^ 0 will kill any nonvanishing asymptotic, stationary current. 
In practice, this then implies that the current induced by the Time-Reversal 
Non-Invariance will survive at most only as a transient. 

To gain deeper analytical insight into this intriguing question we next 
study the ratchet transport in a one-dimensional tight-binding lattice for 
which exact analytical results can be derived. This requires the consideration 
of a quantum transport scheme. 



3 Directed Versus Nondirected Quantum Current 
in Absence of Dissipation 

3.1 Quantum Rectifiers Working Without Dissipation 

To start, let us consider a charged particle such as an electron e < 0 moving 
on a periodic lattice under the influence of a harmonic mixing electric field 
signal F{t)/e := £{t) of the form in (5) with the force amplitudes Ei,E 2 
having now the meaning of scaled electric field amplitudes. We set again the 
phase fluctuations V^(t) = 0. The undriven energy levels for the electron in 
the periodic potential possess a band structure. For the sake of simplicity 
and clarity, we restrict our analysis to the motion of the electron in the 
lowest energy band, neglecting thereby interband transitions. Then, in the 
representation of localized Wannier states, |n), the Hamiltonian of the driven 
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quantum transport problem acquires the form [19, 20] 

hA ^ iv 

HTB{t) = -— + 1| + - ea5(f) ^ n|n)(n| , (7) 

n=-N n=-N 

where HA is the tunneling matrix element between neighboring states and 
2N + 1 denotes the number of sites. We shall describe the dynamics in ter ms 
of the density matrix pn,m- By doing so, we go beyond the standard picture 
of pure Bloch states. The density matrix approach allows one to consider 
electrons prepared in mixed quantum-mechanical states as well. In the limit 
of an infinite (TV — > oo) number of states this single-band tight-binding model 
is integrable and can be solved exactly for arbitrary external driving fields £ (t) 
[19,21,22]. By the term “exactly” we mean that one can obtain an explicit 
analytical expression for the characteristic function, F{k,t) = 

(with -7T < fc < 7 t), of the probability distribution p„(t) = Pn,n{t) to find the 
electron on the site n [22], Following the reasoning in Ref. [19], we find (in 
the limit TV — ^ oo) the explicit result 



n.m '' ^ 



,f)} 



(8) 



where 



S{k,k',t) = A f {cos[k’ - ri{t,T)] - cos[k' - k - T]{t,T)]}dT, (9) 

Jo 

and 

“ y y £{t')dt'. (10) 

With Eq. (8) at hand, any moment of the probability distribution pn(t) can be 
found from Eqs. (8), (9), (10) by taking the respective number of derivatives. 
The first moment, {x{t)) = —iaFj^{0,t), describes the mean position of the 
electron on the lattice, (r(t)) = B reads [21,22] 



ix{t)) = (: 



:(0)) +a\K\A f dr sin[77(r, 0) + tp] , 
Jo 



( 11 ) 



with K = X)„Pra,n-i(0) being the coherence parameter and tan</j = 

Next we introduce the quasi-momentum p{t) obeying the so-called accelera- 
tion theorem, i.e., p{t) = e£{t), with the pseudo-Hamiltonian given by [20] 

H{{x),P,t) = \K\e[p) - e{x)£{t), 



where t{p) = —HA cos(pa/h) is the undriven energy spectrum. One can read- 
ily demonstrate that Eq. (11) provides the explicit solution of the driven non- 
linear classical dynamics described with the pseudo-Hamiltonian H{{x),p) 
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for the initial quasi- momentum p(0) = tup/ a and the initial position (a;(0)). 
These latter two quantities are defined by the initial density matrix p„,m(0)- 

The result in Eq. (11) has some truly remarkable consequences: for ar- 
bitrary external fields we find the prominent result that for a particle be- 
ing prepared in a mixed state characterized by the diagonal density matrix 
Pn,m(0) = Pn(0)d„m, implying a zero coherence parameter K = 0, the mean 
particle position (x{t)) = (a:(0)) is not affected by the arbitrary driving fields. 
As a consequence we find that the current is identically zero [22], i.e., 

j = 0. (12) 

This initial diagonal preparation mimics the classical situation of an ini- 
tially localized particle. In clear contrast to the motion of a classical particle 
in a periodic potential, the quantum mechanical motion of an initially local- 
ized particle - being restricted to the single band dynamics ~ does not support 
a net current. This result is counter-intuitive, - even for a fixed bias there 
results no finite current. On the other hand it is also intuitive because a finite 
current generically would cause dissipation. The counterintuitive classical re- 
sult in section 2.2 can therefore be approached from a quantum transport 
scheme only if we allow as well for interband transitions. 

Is a directed quantum current in absence of dissipation possible never- 
theless? There is still the possibility that with a finite coherence parameter 
K 0 a finite current emerges, e.g., due to broken Time- Reversal-Invariance. 
In doing so, we prepare pure initial states given by the Bloch waves |>i?(0)) = 
Y,n Cn\n), where c„ = For this case, pnm{b) = CnC*^ and the 

coherence parameter is maximal, \K\ = 1 {N oo). Note that, in the ab- 
sence of the external driving, Eq. (11) indicates that any Bloch state carries 
a current j = e{x(t)) = eaAsin(p(0)a//i). In view of our stated prerequisite 
in the introduction, we consider here the case that the initial current is zero, 
yielding p(0) = 0. Then, the tight-binding dynamics driven by a harmonic 
mixing signal with fixed relative phase, Eq. (5), yields a finite limit in Eq. 
(4) . The current in absence of dissipation emerges in this case as 



OO 

ihm = sAa ^ 
k=~oo 



X Sin 



k(f> - ^1 sin(V’) - -6 sin(2'0 -I- 



(13) 



where ^ 1,2 = eaEip/{huj). This result holds for the fixed phase V'(f) := ip, cf. 
Eq. (5). In the lowest order of the electric field amplitudes and for 'ip{t) = 0 
we find 



Jhn 



r 1 . /eaEi\^eaE 2 

—eAa [— — — — 

L16 \ huj / hoj 




eaE2' 

huj . 



sin((^). 



(14) 



We notice that the current is identically zero when ^ = 0, cf. Eq. (14). How- 
ever, this current is finite for cp ^ 0. This fact can - misleadingly - be inter- 
preted as a current that originates due to broken Time-Reversal-Invariance. 
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Note, however, if we put = 0 in Eq. (14) the current still exists for ^ 0, 
although the time-reversal symmetry is restored. This means that the finite 
current emerges already in the presence of a single harmonic driving due to 
the initial phase shift, 0^0. The latter one generates an effective initial 
momentum of the particle, and thus results in a finite current. In absence 
of any phase fluctuations this (coherent) current carries no dissipation and 
it fails to decohere. Nevertheless, if we assume that the initial field phase ip 
is randomly distributed in the interval [0, 2tt\ with the probability density 
P{ip) — 1/27T, one can show that after the corresponding static averaging 
over tp the current jhm in Eq. (13) is zero independently of the relative phase 
shift 0. Moreover, we will show now that the dynamical phase fluctuations 
xp{t) also yield decaying current toward zero. 

3.2 Role of Phase Fluctuations 

Let us consider a simple model of dichotomous Markovian phase fluctuations 
ip{t). This model allows for an exact analytic treatment, i.e. we set 

xp{t) = xpQOL{t), (15) 

where V’o denotes the amplitude of phase fluctuations and a{t) = ±1 is 
the dichotomous Markov process (DMP) with the stationary autocorrelation 
function (a(t)a(t')) = exp(-i/|t - t'|) [24]. The parameter u is the mean 
frequency of random phase jumps and defines the dephasing time tq = 1/v. 
Using the relations, cos[tf>(t)] = cos{‘tpo) and sin[0(t)j = sin(0o)o!(*)> the 
external driving can be recast into the form 



£{t) =£{t)~ —g{t)a{t), (16) 

ea 

where £{t) is given by Eq. (5) for ■0(t) = 0, but with the renormalized am- 
plitudes El -t El = El cos{‘ipo) and E 2 -t E 2 = E 2 cos{2ipo)- Moreover, the 
function g{t) in Eq. (16) reads 



5(f) = 9i sin(wt) -I- g 2 sin(2wt -I- 0), 



(17) 



where the amplitudes gi = eaEi sm{ipo) / h and g 2 = eaE 2 sm{2ipo) / H have 
the dimension of a frequency. 

In the presence of random phase fluctuations the stochastically averaged 
time-dependent current is given by [22] 






(18) 



where the outer average (...)^ denotes the average over the phase fluctua- 
tions. The stationary current then is given by j = limt_yoo j{t)- For the most 
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interesting case with a coherence parameter of \K\ = 1, it follows from Eq. 
(11) that 



j{t) = eaA X Im| exp ^i[rj{t,0) +p(0)o//i]j({7(t))^|, (19) 

where ^(t, 0) is defined in Eq. (10), but with £{t) taken from Eq. (16). The 
function {U{t))^ := ^ exp [-t a(T) 3 (T)dr]^ in Eq. (19) is the averaged 
solution of the auxiliary stochastic differential equation 

U{t) = -ig{t)a{t)U{t), (20) 

which describes a generalized Kubo oscillator [24] with the stochastic fre- 
quency fi{i) = g{t)a{t). The averaged solution of Eq. (20) can be written by 
virtue of the Floquet theorem in the form 

{U(t))^ = +e“^^‘u2(t), (21) 

with positive- valued Floquet values A , 2 > 0, and time-periodic Floquet 
modes tii,2(t+27r/cu) = ui, 2 (t). It then follows from Eq. (19) that the smallest 
of the two Floquet exponents, F = min{ri,/ 2 } in Eq. (21) characterizes the 
time scale on which the (transient) current due to the broken Time Rever- 
sal Symmetry does exist. Even if the current exists in the absence of phase 
fluctuations t^(t), it will relax in real life situations for times t F~^. This 
result that in the presence of a random driving a stationary {t oo) current 
cannot be realized in absence of dissipation has been shown by us previously 
in Ref. [22]. Next, we shall evaluate this time scale explicitly. 

The averaged solution of Eq. (20) with g{t) = const has been given by 
Kubo [25]. It can also be looked up in the book by Van Kampen [24]. In our 
case, the problem is more intricate. To solve the task we apply the formalism 
of the so-termed “formulae of differentiation” [26] to yield the coupled set of 
differential equations 

^{ait]U{t))^ = -u{a{i)U{t))^ - ig{t){U{t))^ (22) 

for the average {U{t))^ and the correlation {a{t)U{t))^. The initial conditions 
in Eq. (22) follow as (17(O)).0 = 1 and {a(0)17(0)}^ = 0. From here on, sailing 
becomes smooth by observing that the set (22) is indeed equivalent to a Hill 
equation for To solve (22) we use the transformation {U{t))^ = 

r(t) cos[#(t)/2], {a{t)U (t))^ — zr(t) sin[#(t)/2], and end up with 

r{t) = — i/sin^(<f(t)/2)r(t), 

${t) = -r/sin[#(t)] - g{t) 



(23) 
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for the new variables r{t) and The initial conditions transform into 

r(0) = 1, and ^(0) = 0. In terms of the unknown solution Eq. (23) 
yields for the averaged solution of the stochastic differential equation (20) 
the result, 



= exp{-i/ 



I 



t 

sin^[#(r)/2](iT} 



cos[#(t)/2]. 



(24) 



This formal expression holds for an arbitrary function g{t) and is not re- 
stricted to the class of periodic functions only. Because the second equation 
in (23) cannot be integrated in closed form for g{i) given in Eq. (17) the 
solution {U{t))^ remains implicit. However, one can deduce the correspond- 
ing decay rate F in an analytical form for relevant limiting cases. The most 
interesting one is the case of a highly coherent field with small field strengths 
such that u cj and gi ,2 <SC oj. In this case, the amplitude of oscillations of 
${t) is small, ^{t) 1, and one can expand sin[#(t)] « #(f) in (23). After 

some straightforward calculations we obtain in the lowest order in the driving 
field strengths for the rate 



implying for the transient current (for the central result 

j(t) = jftmexp(-rt). 



(25) 



(26) 



with jhm is given in Eq. (14). 

This result inherits the following consequences, (i) A nonzero stationary 
current does not exist, (ii) The decay rate F for the transient current is deter- 
mined by the mean rate of phase fluctuations u, the amplitude of the phase 
fluctuations ipo and further also by the intensities of the field components 
eaEifilhu. (hi) With the increasing field strength, not only does the field- 
induced current jhm increase, cf. Eq. (14), but at the same time the current 
decay rate is also enhanced, cf. Eq. (25). This latter fact may render consid- 
erably more difficult the experimental observation of the decaying transient 
current. 

To decide whether the coherent field induced current is stationary or not 
one can put forward the following criterion: (1) introduce small phase fluc- 
tuations ip{t) in the otherwise strictly periodic field S{t), cf. Eq. (5), and (2) 
evaluate the limits in the sequence 

Ita lim ■*(««)»■> . (27) 

1 / or tpQ—^O t-^oo at 



The order of limits in Eq. (27) is very important and cannot be interchanged. 
The application of this criterion to the current in the absence of dissipation 
yields j = 0, meaning that no finite stationary contribution survives. 
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3.3 Stationary Quantum Current in the Presence of Dissipation 

In the previous section we demonstrated that the field-induced current is at 
most a transient phenomenon under realistic conditions. The role of finite 
dissipation is thus crucial to produce possibly nonvanishing, stationary di- 
rected currents. Directed net current emerging in a tight-binding model due 
to the combined action of dissipation and external driving has been studied 
in the recent literature in Refs. [16,22,23]. The main result of these works 
is as follows: The directed current appears in form of a nonlinear response 
to the external driving field if any odd moment of the unbiased driving field, 
is different from zero. Here, denotes averaging over the 

period of driving. In the lowest third order of the harmonic mixing driving 
strengths one finds that the dissipative result jst [16, 23] is proportional to 

jst oc (£^(t))^ oc EIE 2 cos(i^). (28) 

The nontrivial prefactor involves the dissipation strength and temperature, 
see in Ref. [16,23]. We state (without proof) that the application of the 
criterion in (27) does not influence the result in Eq. (28); the current is 
stationary and does not decay in ti m e. 
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Abstract. The behavior of single molecular motors such as kinesin or myosin V, 
which move on linear filaments, involves a nontrivial coupling between the bio- 
chemical motor cycle and the stochastic movement. This coupling can be studied 
in the framework of nonuniform ratchet models which are characterized by spa- 
tially localized transition rates between the different internal states of the motor. 
These models can be classified according to their functional relationships between 
the motor velocity and the concentration of the fuel molecules. The simplest such 
relationship applies to two subclasses of models for dimeric kinesin and agrees with 
experimental observations on this moleculcir motor. 



1 Introduction and Overview 

Molecular motors are ubiquitous in living cells. Indeed, it has been recently 
realized that all transport processes or movements which occur within the cell 
in a coherent fashion are governed by such motors. Examples are provided 
by transmembrane transport of ions and macromolecules, regulated adhesion 
and fusion of membranes, intracellular vesicle transport, cell division, and 
cell locomotion. [1] 

In general, one may distinguish several types of motors: (i) pumps which 
are membrane proteins used to transport ions and small molecules across the 
membrane ^ ; (ii) rotary motors such as the bacterial flagellar motor and Fi- 
ATPase which are again membrane-bound structures; and (iii) linear motors 
which move along filaments. 

In the following, I will focus on linear motors which move on filaments, 
and which are processive in the sense that they make many steps before they 
detach from the filament. Such motors are responsible for vesicle transport 
and for the (re)organization of the cytoskeleton. It has been estimated that 
a typical eucaryotic cell might contain between fifty and a hundred different 
types of linear motors [3]. Several superfamilies of molecular motors have 
been identified. One of these families consists of kinesin and kinesin-related 
molecules which move along microtubules [4]. 

During the last couple of years, new experimental techniques have been 
used in order to measure the performance of these motors on the mesoscopic 
scale. The most important property which quantifies this performance is the 

^ It is amusing to note that these pumps act as Maxwell’s demons [2] who (or 
which!) are able to sort two types of molecules into two different compartments. 
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motor velocity. This latter quantity has been studied for three different classes 
of motor molecules: (i) Dimeric kinesin on microtubules [5-9]; (ii) Monomeric 
kinesin on microtubules [10]; and (iii) Myosin V on actin filaments [11], 

The functioning of molecular motors has also been studied from a theoret- 
ical point of view using different types of motor models [12-21]. In fact, the 
variety of models which can be found in the literature is somewhat confusing. 
In this short review, I will discuss the present status of the relation between 
theory and experiment and some recent attempts to clarify this relation. 

The paper is organized as follows. First, Section 2 contains a short sum- 
mary of the experimental information on dimeric kinesin and on the different 
theoretical models which have been used to describe its motor properties. The 
nontrivial coupling between the biochemical cycle and the mechanical move- 
ment can be studied in nonuniform ratchet models with spatially localized 
transition rates as defined in Section 3. These models lead to simple relation- 
ships between the motor velocity and the fuel concentration, see Section 4, 
which can be used to classify these models. 



2 Experiment versus Theory 

So far, only a few experiments have been reported for monomeric kinesin and 
for myosin V. Dimeric kinesin, on the other hand, has been experimentally 
studied in considerable detail. This experimental work has provided several 
clues to the latter motor, both with respect to its biochemical and geometric 
features on the molecular scale and with respect to its motor properties which 
characterize its performance on supramolecular scales. 



2.1 Experiments on Dimeric Kinesin 

Dimeric kinesin moves on microtubules as illustrated in Fig. 1. The micro- 
tubule is a linear filament consisting of 13 protofilaments of tubulin molecules 
which form a hollow cylinder. Each protofilament represents a 1-dimensional 
lattice with a lattice constant of 8 nm. The motor consists of two identical 
amino-acid chains which form two heads. Each kinesin head can act as an 
ATPase which adsorbs and hydrolyses ATP. In addition, each head can bind 
to and unbind from the microtubule. Thus, each head has an ATP-adsorption 
domain and a microtubule-binding domain. 

All experimental studies are consistent with the view that dimeric kinesin 
moves in a ’head-over-head’ (or ’hand-over-hand’) fashion, i.e., by alternat- 
ing steps in which one head moves forward while the other one remains bound 
to the tubule. If the motor does indeed advance by this type of stepping mo- 
tion, the unbound head and the center-of-mass of the motor would move by 
16 nm and by 8 nm, respectively, during each step. 

The relative displacement of the kinesin motor against the filament was 
determined by optical trap experiments. The most direct evidence comes 
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Fig. 1. Bound state of dimeric kinesin on a microtubule - The two heads of the 
kinesin molecule axe bound to two adjacent tubulin segments which are 8 nm apart. 
In this cartoon, the stalk of the kinesin, which is about 50 nm, has been reduced 
compared to the diameter of the microtubule, which is about 25 nm. 



from experiments in which the filament is firmly attached to a solid substrate 
and the motor molecule is anchored to a bead. This bead is grapped by the 
optical tweezers and then brought into contact with the filament. In these 
experiments, one can directly measure the time evolution of the displacement 
of a single motor molecule (plus the attached bead) . From a large number of 
such displacement- versus-time curves, one obtains average motor properties 
such as the motor velocity which characterize the motor performance on 
length scales large compared to the step size. 

For dimeric kinesin, the motor velocity has been measured as a function 
of two control parameters. The first such parameter is provided by the ATP 
concentration F, i.e., by the concentration of the fuel molecules. The sec- 
ond control parameter is given by the external force F usually applied by 
the optical trap. Several experiments have shown that the motor velocity v 
increases monotonically with the ATP concentration F and exhibits a satu- 
ration behavior. In fact, it has been found for dimeric kinesin that the data 
for V = v{F) can be fitted by the functional form [5,7,8] 

^;(r)~wr/(r.+r) (i) 

for vanishing force F (or for small values of F). Furthermore, if one uses Umax 
and Ft as F-dependent fit parameters, this functional form seems to apply 
over the whole range of accessible load forces as given by 0 < |F| < 5.6. [9] 

In the presence of an external load force, the motor velocity is observed to 
decrease monotonically with increasing load. The precise functional depen- 
dence of velocity versus force has been a matter of some controversy. In fact, 
if the load force is applied to the motor via an attached bead, one generates 
two force components, one which is tangential to and one which is normal to 
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the filament [7] Since the tether between the bead and the kinesin molecule 
is not expected to behave as a linear spring, the force applied by the opti- 
cal trap may not be simply proportional to the tangential force acting on 
the motor molecule. In view of these uncertainties, I will focus here on the 
concentration dependence of the motor properties. 

2.2 Different Types of Theoretical Models 

Any molecular motor acts as a processive enzyme, the activity of which re- 
quires a certain conformational state of the motor. Since the movement of 
the motor is directly related to its conformation, one has a nontrivial cou- 
pling between this movement and the enzymatic activity of the motor. This 
coupling represents a nontrivial constraint on the modelling of molecular mo- 
tors. Several types of motor models have been studied which differ in the basic 
assumptions about this coupling. One can distinguish three different cases: 
(i) Tight-coupling models - In these models, one assumes that the 
biochemical cycle is independent of the mechanical movement and that the 
latter movement simply follows this cycle which consists of several conforma- 
tional or internal states [5, 7, 12, 13, 16, 20]. 

(ii) Uniform ratchets - Here, the degrees of freedom which are related to 
the mechanical movement are taken into account explicitly. The motor can 
attain several internal states and its position is described by a spatial co- 
ordinate, say X. However, the enzymatic activity, which leads to transitions 
between these internal states, is again taken to be independent of the confor- 
mation and, thus, of the position x of the motor. Examples for these types 
of rqodels are ratchets with flashing potentials [14] and with several internal 
motor states but spatially uniform transition rates [15, 17, 19]. 

(hi) Nonuniform ratchets or diffusion-reaction models - As in the 
uniform case, the motor can attain several internal states and its position is 
described explicitly but, in addition, one now incorporates the crucial fea- 
ture that the enzymatic activity depends on the spatial position. Thus, these 
models are characterized by transition rates between the internal states which 
depend on the spatial coordinate x. [15, 19,21] 

Models which are intermediate between case (ii) and (iii) correspond to ratch- 
ets with flashing potentials where single potential segments can be switched 
independently [18]. 

As far as the concentration dependence of the motor velocity is concerned, 
these different types of models lead to the following relationships: 

(i) Tight— coupling models - It is assumed that the enzymatic activity 
is governed by Michaelis-Menten kinetics. [5, 7] This implies that the func- 
tional dependence of the ATP-hydrolysis rate w on the ATP concentration F 
is given by Whyd(7^) = Wgat-E/(r, -t-jT). It then follows from the tight-coupling 
assumption and the size Ax for a single motor step that the motor velocity 
V is simply given by v{F) = LJhyd{r)Ax. This agrees with the experimentally 
observed dependence as in (1). It turns out, however, that this functional 
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dependence also holds for a large class of nonuniform ratchets, see below, 
and, thus, cannot be regarded as strong evidence for the tight coupling as- 
sumption. 

(ii) Uniform ratchets - These models lead to a functional form of the motor 
velocity v which exhibits a maximum as a function of the transition rates. 
The same behavior is found for flashing potentials with independent switch- 
ing of potential segments. Since the ATP concentration F enters via these 
rates, these models also predict that the motor velocity v = v{F) decreases 
for large F, in disagreement with the experimentally observed dependence 
( 1 )- 

(hi) Nonuniform ratchets - These ratchets can lead to a motor velocity 
which increases monotonically with the ATP concentration F. This was first 
found for ratchets with two internal states and with localized transitions at 
two spatial positions. [15, 19] We have recently generalized this theoretical 
framework and introduced nonuniform ratchet models which are character- 
ized by M internal states and by transitions at K spatial locations within one 
potential period [21]. These models are described in the following Section 3. It 
is possible to determine and classify the functional dependence v = v{F) for 
arbritrary M and K, see Section 4. In particular, several classes of (M, K)- 
models can be identified which lead precisely to the hyperbolic form as given 
by (1). 



3 Nonuniform (M, K) Ratchets 

The theoretical framework used here is based on the time evolution of the 
probability densities Pm{x,t) to find the motor particle at center-of-mass 
coordinate x and in internal state (or level) m which can attain M values m = 
1, . . . , M. For a given position x, each probability density Pm may change (i) 
because of lateral diffusion in state m which leads to lateral currents Jm or 
(ii) becauce of transitions between the different internal states. ^ Therefore, 
the probability densities Pm satisfy the continuity equations dPm{x,t)/dt + 
dJm(x,t)fdx = with the transition current densities Im- 

The lateral currents Jm depend on the molecular interaction potentials 
Um{x) and on the external force F which define the effective force potentials 

Vm{x) = (Umix) - Fx)/T (2) 

where T is the temperature in energy units. Note that F is the force compo- 
nent which acts tangential to the filament. The molecular interaction poten- 
tials Um{x) are periodic with potential period For kinesin on microtubules, 
one has = 16 nm. The lateral currents Jm then have the Smoluchowski- or 

^ These models can also be applied to rotary motors for which x represents an 
appropriate angular coordinate. 
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Fokker-Planck form [22, 23] 

* ^ d ' 

t) = ~Dq ^ t) (3) 

where the parameter Dg represents the small-scale diffusion coefficient. 

The transition current densities Im depend on the transition rates Qmn — 
^mn{x) from state m to state n and have the generic form 

Im{x,t) [-P^{x,t)Ornn{x) + P„{x,t)firim{.x)] (4) 

n 

where the prime at the summation sign indicates that n is restricted ton ^ m. 
The transition rates fimn{x) are taken to be localized in space at the discrete 
set of K positions x = Xk with k = 1,. . . ,K and 0 < < . . . < xn < i and 

are expressed as 

^mn{x) = ^ S{x Ij,) (5) 

k 

where ujmnixk) > 0 are transition rate constants, £q ^ represents a molecu- 
lar ’localization’ length, and 5(z) is Dirac’s delta function. The paxametriza- 
tion in terms of delta functions is useful since the nonuniform ratchets or 
reaction-diffusion models can then be solved analytically. [21] 

The ratchet models just defined contain both the applied force F which 
enters explicitly in (2) and the fuel concentration P which enters via the tran- 
sition rate constants 0Jmn{xk) in (5). Explicit solution of these models shows 
that the dependence on the rate constants and, thus, on the fuel concentra- 
tion P exhibits some generic or universal features. These universal features 
will now be discussed for the motor velocity v = v{P). 

4 Dependence on Fuel Concentration 

In a stationary state, the velocity v is related to the total lateral current 
Jtot = Y^rn ^ where £ is the spatial period of the molecular 

interaction potentials. Thus, the concentration dependence of the motor ve- 
locity is determined by the dependence of Jtot on the rate constants uimn{xk)- 



4.1 Dependence on Rate Constants 



First, let us consider a nonuniform ratchet with arbitrary M and K and let 
us focus on a single rate constant oj = <j^mn{xk)- Using a transfer matrix 
method, one can show that all (M, iF)-models lead to the simple functional 
dependence 



Jtot(^) 



do diOJ 
bo + biOJ 



( 6 ) 
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for the total lateral current Jtot where the coefficients Uj and bj with j = 0, 1 
depend on the other model parameters. 

Likewise, the dependence of the total lateral current on two transition 
rates, say uJi and W 2 , is found to have the generic multilinear form 






Oo “h flimi + a2U>2 + 03^1^2 
bo + hicui + 62^2 + 63W1W2 



( 7 ) 



with coefficients aj and bj which again depend on the remaining model pa- 
rameters. 

The functional dependence as given by (7) represents the most general 
form. In practise, some of the coefficients aj and/or bj in (7) may vanish. This 
can happen, for instance, if some of the transition rate constants Wmn(^fc) 
in (5) are identically zero. The simplest example is given by a 2-state model 
with (M,K) = (2,2) and the transition rates 



Oi 2 (x) = - xi) and n 2 i(x) = U 2 £nS(x - X 2 ) . (8) 



In this case, the coefficients ao and bo in (7) are identically zero and the 
coefficients ai and 02 vanish for F = 0. 



4.2 Concentration Dependence of Motor Velocity 

As mentioned, the concentration F of the fuel molecules enters via the rate 
constants ujmnixk)- First, assume that only one of these rate constants, say 
w, is T-dependent. If one assumes that the corresponding chemical reaction 
follows Michaelis-Menten kinetics [24], one has 

u>~^ = {ciF)~^ • (9) 



where C\ and C 2 are two T-independent rate constants. If this is inserted into 
the expression (6) for Jtot> one obtains the motor velocity 



v{F) = Urea + (Vaat 



^res) 



r 

r. + r 



( 10 ) 



with the residual velocity v^es = n(T' = 0) and the saturation velocity Usat = 
v{F = 00 ). The same n(T')-relationship may also apply if the motor cycle 
involves two T-dependent rate constants wi(T') and u> 2 {r). One example is 
provided by the 2-state model with the transition rates (8) when both (F) 
and oj 2 {F) are related to F via a Michaelis-Menten-type relation as in (9). 

On the other hand, if the total lateral current Jtot {^ 1 ,^ 2 ) has the more 
general form (7), the T-dependence of the motor velocity is given by 



n(T') — Vres 



CT + T2 

+ (Usat Vres) ^ ^ p2 



( 11 ) 



with two T-independent coefficients c and d. 
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4.3 Ratchets with {M, K) — (3, 2) 

Let us now return to the case of two-headed motors. In general, the corre- 
sponding ratchet models will be characterized by two locations with enzy- 
matic activity. If each head (i.e., each enzymatic domain) can be activated 
only at one of these locations, one has only two J'-dependent rate constants. 
One example for such a model is provided by the previously described (2,2) 
ratchet with the transition rates (8). If both heads can be activated at both 
locations, one has a ratchet model with four J'-dependent rate constants. One 
such model with M = 3 internal states and transitions at K = 2 locations 
will now be discussed. 

As shown in Figs. 2 and 3, the three internal states are now labeled by 
m = 0,1,2. The ground state with m = 0 corresponds to a doubly-bound 
state of the two-headed motor, i.e., to a state in which both heads are bound 
to the microtubule. The excited state with m = 1 corresponds to a state 
in which one of the heads, say head 1, is unbound while the second head 2 
is still bound to the tubule. Likewise, the second excited state with m = 2 
corresponds to a state in which head 2 is unbound and head 1 is bound. Since 
both heads are taken to be identical (as for dimeric kinesin), the two force 
potentials Ui(x) and 1 / 2 ( 2 ;) for the two excited states have the same potential 
period £ and are related via U 2 (x) = Ui(x — £12), see Fig. 2. 




Fig. 2. Ratchet with {M,K) = (3,2): Functional dependence of the molecular 
force potentials Um for the three internal states m = 0, 1, 2 on the center-of-mass 
coordinate x. The potentials Ui and U 2 for the two excited states have potential 
period I and are related via U 2 {x) = Ui{x — 1/2). The shaded vertical stripes 
represent the localized transitions, compare Fig. 3. 



The symmetry between the two heads also implies that the four transition 
rates from the ground state to the excited states 1 and 2 and back to the 
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Fig. 3. Ratchet with (M, K) = (3, 2): Transition rates at the two spatial locations 
X = x\ = Q and x = X2 = (.j 2 . The rate constants uji and UJ2 characterize the 
unbinding of the trailing and the leading head, respectively, the rate constants ui 
and 1^2 the rebinding of these heads to the filament. The unbinding rate constants 
u>i and u >2 depend on the fuel concentration F. 



ground state must all be periodic with period £ and must be related via 
1 ^ 02 ( 2 :) = 1^01 ( 2 ; - ^/2) and O 2 o(x) = f2io(x - ^/2). Thus, one has to specify 
only two of the four transition rates, say J?oi and f?io. The unbinding rate 
Qqi depends on two rate constants, cui = cutr and L 02 = wie, for the trailing 
and the leading head, respectively, and is given by 

Hoiix) = uJi£oS{x - £/2) + U2ia5{^) ■ (12) 

Likewise, the rebinding rate l2io(a:) contains two different rebinding rate con- 
stants, j/i = i^tr and V 2 = r'le) and has the form 

Qio{x) —vitn5{x- Il2) + V2tn5{x) . (13) 

Thus, the 3-state model contains 2x4 = 8 transition rates as shown in 
Fig. 3. If the T-dependent unbinding rate constants Wi and W 2 now satisfy 
~ W 2 ~ w(T') with u){r) as given by the Michaelis-Menten relation (9), 
this (3,2) ratchet leads again to the simple u(T')-relationship as in (10). [21] 

5 Summary and Outlook 

In summary, the functional dependence of the motor velocity v on the con- 
centration F of the fuel molecules has been analysed for nonuniform ratchet 
models with M internal states and transitions at K spatial locations. This 
functional dependence is determined by the number of T-dependent rate con- 
stants and can be classified into simple polynomial forms as in (10) and (11). 
In addition, two subclasses of models for dimeric kinesin with (M, K) = (2, 2) 
and {M,K) = (3,2) lead to the simplest possible relationship (10) which 
agrees with the experimentally determined fit as given by (1). 

It is possible to extend the above analysis by incorporating the limiting 
case of vanishing fuel concentration for which one must have detailed balance. 
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This leads to a generalized classification scheme for the motor velocity v = 
v{r, F), i.e., for the dependence of the velocity on the two control parameters 
r and F. [25] 

Acknowledgements I thank Thomas Harms for enjoyable collaborations 
and Theo M. Nieuwenhuizen for a critical reading of the manuscript. 



Glossary: List of Symbols 

All symbols are treated as words which are ordered alphabetically. 

Do diffusion coefficient in lateral currents 

F applied (tangential) force; a load force corresponds to F < 0 

F concentration of fuel molecules such as ATP 

F* characteristic intermediate concentration 

Im transition current density for internal state m 

Jm lateral current for internal state m 

Jtot total lateral current 

K number of locations for transitions between internal states 
t period of molecular force potenti 2 ds 

in molecular ’localization’ length for transition rates 

M number of internal motor states 

V rebinding rate constant 

Pm probability density for internal state m 

fimn spatially dependent transition rate from state m to state n 

ui unbinding rate constant 

u)mn transition rate constant from state m to state n 
X spatial coordinate for motor position 

Xk position at which motor undergoes localized transition 
t time 

T temperature in energy units 

Um molecular force potential for internal state m 

Vm effective force potential as defined in (2). 

V motor velocity 

Ures residual velocity for small concentration F 
Usat saturation velocity for large concentration F 
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Abstract. One can argue that the essence of life is in the ability to drive reactions 
that require energy by coupling them, via enzymes, to other reactions that release 
energy. Traditionally such reactions and the consequent energy flows are presented 
as being coupled lineeirly through a matrix. Below we present an example where 
the coupling is quadratic. We show how such coupling can arise chemically. When 
operated near equilibrium the resulting system is able to “ratchet” chemical con- 
versions, i.e. allow an A ^ B, but block the B ^ A reaction, even if A and B have 
the same energy. With quadratic coupling it is furthermore possible to convert the 
energy of oscillations into a steady metabolic flux. 



Nowadays every textbook in molecular biology contains numerous ex- 
amples of enzymes that catalyse a reaction and use the released energy of 
that reaction to drive another reaction energetically uphill [1] . The most no- 
table example is the Na,K-ATPase. This protein takes an ATP (adenosine 
triphosphate, the common currency of energy in a living cell) molecule and 
hydrolyses it into ADP (adenosine diphosphate). Catalysing this hydrolysis 
involves a number of conformational changes of the protein and in case of the 
Na,K-ATPase these conformational changes include ion transport across the 
membrane against the electrochemical gradient. For every hydrolysed ATP 
three sodium ions are pumped from the inside to the outside of the cell and 
two potassium ions are pumped from the outside to the inside. It is in this 
way that the transmembrane potential, which is essential for the cell, is main- 
tained. Fig. 1 shows a scheme to illustrate in terms of chemical kinetics how 
ATP hydrolysis can power the conversion of a substrate S into a product P. 

In Fig. 1 ATP hydrolysis is depicted along the horizontal coordinate. Go- 
ing from right to left energy decreases as ATP is hydrolysed. But part of the 
energy released in ATP hydrolysis is used to bring the enzyme from a state E 
into a new conformational state E* with a higher energy. The enzyme can go 
back to state E by converting one molecule S into P. This will only work if the 
energy A17 atp that is released in ATP hydrolysis is larger than the energy 
AUsp that is required for an S — > P conversion. This condition translates into 
fc+i[ATP]fc+ 2 [S] > A:_i[ADP]fc_ 2 [P]. In that case a net S — > P conversion will 
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Fig. 1. A kinetic scheme to show how, in a catalytic cycle of an enzyme, the hydrol- 
ysis of ATP can be coupled to the conversion of a substrate S into a product P. The 
enzyme can exist in two forms, E and E* . ATP hydrolysis brings the enzyme from 
state E into state E*, which heis a higher energy. Next this energy is transferred to 
an S -> P conversion as the enzyme goes back from E* to E. For the process to 
occur in the upward right to left direction it is necessary that AUatp — AUsp > 0. 



occur. It is obvious that in case of fc+i[ATP]/:+ 2 [S] < A:_i[ADP]fc_ 2 [P] the P 
-t S conversion will power the production of ATP out of ADP and the net 
flow in Fig. 1 will be downward and from left to right. Thermodynamically 
such processes are described by a linear coupling [2]: 



(JA _ (Lii Lu\ fXA 

{J2J {L21 L22 J \X 2 J ■ 



( 1 ) 



Here J\ is the ATP — )■ ADP flow and J 2 is the S — t P flow. Xi represents the 
ATP/ ADP chemical potential and X\ represents the S/P chemical potential. 
Alternatively, one can denote with J\ the energy lost through ATP-hydrolysis 
and with J 2 the energy gained in the S — ^ P conversion. 

In this paper we will present a kinetic scheme that is only slightly more 
complicated than the one in Fig. 1 to show that it is theoretically possible 
to drive an S — ^ P conversion with either an ATP — ^ ADP or ADP -> ATP 
potential. In these situations the coupling is not linear, but quadratic. Taking 
^2 = 0 we have at leading order: 



Ji = LiXi 

h = L 2 XI ( 2 ) 



So the induced flow J 2 is always in the same direction. The Curie principle 
[2] , which states that you cannot induce a directionality in the system that is 
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not already there from the outset, seems to no longer hold. It doesn’t matter 
in which direction the force and the flow J\ are, the induced coupled flow 
J 2 in Eq. (2) is always in the positive direction if L 2 is positive. 




Fig. 2. (2a) A 2D one state Markov model. (2b) Transitions along the 45° line 
correspond to S ^ Pi conversions. Trcinsitions along the 135° line correspond to 
S P 2 conversions. (2c) Transition rates have been picked such that the force 
dependence along the 45° line is equally apportioned, while along the 135° line the 
G dependence is equally apportioned, but the S — > P 2 transition depends on H and 
the P 2 — > S transition does not. In the text it is shown how at G = 0 the force H 
leads to flux in the horizontal direction. 

Next consider the 2D setup presented in Fig. 2. It is a one state model, but 
there are four different ways to get to a neighboring state (Fig. 2a). Fig. 2b 
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shows that going up on the 45° line the substrate S is converted into product 
Pi- Going up on the 135° line the substrate S is converted into product P 2 . 
Going down on the 45° and the 135° line represents the conversion into S of 
Pi and P 2 respectively. So moving from left to right P 2 is converted into Pi. 
Moving up represents the conversion of S into equal amounts of Pi and P 2 . 
Chemical gradients of the S ^ Pi, S ^ P 2 and Pi P 2 reactions translate 
into a vertical force H and a horizontal force G . The [S] = [Pi] = [P 2 ] 
equilibrium corresponds to G = ff = 0. The distance between the rows as 
well as the columns is taken to be unity and each state has a population of 
one. This implies that the energy difference between two states on the 45° 
line is G + H. The energy difference between two states on the 135° line is 
-G + H. The states of the enzyme are identical so the chemical forces are 
due solely to concentration differences among S, Pi and P 2 . When we take 
the energy in units of ksT we have on the 45° line: 



JSL 

[Pi] 






(3) 



On the 135° line the conversion of S into P 2 is a unit step against the force 
G. So we get 

[P 2 ] 

From these last two equations it is easily seen that 



= e^-o+H)_ 



(4) 




Fig. 3. A reaction coordinate between the states at x = 0 and x = 1. The transition 
rates over the barrier depend exponentially on the barrier height. When an external 
force F is applied the position on the x-coordinate of the maximum determines the 
apportionment (cf. Fig. 2) of the factor over the two transition rates (see text). 

If one of the states in Fig. 1 has a much smaller dwelling time than the 
other state we effectively look at a one state model. In this one state model S 
and ATP are like one substrate S'. ADP and P are like one product P'. The 
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picture is then one of an enzyme that is “hopping” along a line of identical 
states and dissipates energy as it converts S' into P'. If the enzyme can turn 
S' into either P'j or P 2 , we can get the situation described in the previous 
paragraph. 

Fig. 3 shows a reaction coordinate that underlies chemical transitions like 
in Fig. 2. Going from the state at x = 0 to the state at x = 1 involves 
moving over an activation barrier between these states. The line with slope 
F represents the effect of a net force F along the x-direction. Were it not for 
the macroscopic force F, the states at x = 0 and x = 1 would have the same 
energy level. Transition rates depend exponentially on barrier height, so we 
get A:o->i = aexp[-£; - XmaxF] = aexp{-XmaxF) and ki^o = aexp[-E + 
(1 — Xmax)F] = oexp[(l — Xmax)F]. Obviously this approach is only valid 
when F is of the order of E or smaller. For Xmax = 1/2 the force F is 
equally apportioned over the two states. It is only when Xmax 1/2 that an 
anisotropy is introduced in the system that results in unequal apportionment. 

In the example in Fig. 2c there is equal apportionment in the 45° direc- 
tion and unequal apportionment in the 135° direction. For convenience the 
two activation energies have been picked such that the prefactors before the 
exponentials are all equal to one. Next we will show that for this choice the 
vertical force H can bring about flow in the horizontal direction and that the 
flow force relations, at leading order, follow the pattern of the Eq. (2). We 
have in a steady state for the net flows in the horizontal and vertical direction 
respectively: 



Jx =2 sinh 




-h 2e2-'^sinh 


^G-H) 


Jy =2 sinh 


\{G + H) 


- 2e5-^ sinh 


1 

■ — > 



( 5 ) 



If we take G = 0 and iF ^ 0, then we get for the horizontal flow induced by 
the vertical force: Jx = 2(sinh y)(l — exp y), which at leading order behaves 
quadratically like For the vertical flow we get Jy = 2sinhy-t-(e^ — 1), 

which at leading order behaves linearly like 2H. So we have the structure 
of Eq. (2) with Xi denoting H and Ji and J 2 denoting the vertical and 
horizontal flows respectively. 

So we take the system of Fig. 2 at G = 0. This implies [Pj] = [P 2 ] and 
[S]/[Pi] = [S]/[P 2 ] = e^. Chemically this system has some very curious 
properties and possibilities. A positive substrate - product potential {H > 0) 
leads to horizontal right to left flux, i.e. production of P 2 from S. But in case 
of a negative substrate - product potential {H < 0) we still get a net right to 
left horizontal flux and then it is Pi that is consumed in order to produce S. 
So with this system we can produce a desired product P 2 when [S] is large and 
not consuming any P 2 when [S] becomes small. It is thus possible to produce 
an essential metabolite P 2 and not deplete the P 2 reserves if the supply of S 
ceases. Effectively we have created a chemical ratchet here: S — t P 2 occurs 
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when the chemical force is in that direction, but when the chemical force 
reverses the P 2 — t S pathway is blocked. Another interesting feature is that 
with this system we can get a steady production of P 2 from Pi by oscillating 
or fluctuating [S] around the H = 0 equilibrium. So we have a chemical 
AC to DC conversion. An oscillation or fluctuation of [S] can be brought 
about by an externally applied oscillating electromagnetic field. But there 
are also many autonomously generated oscillations in living cells (calcium 
oscillations [1] or glycolytic oscillations in yeast [3,4]) and it is conceivable 
that these oscillations aid in the production of certain metabolites via the 
above mechanism. 

The processes pointed out in the last paragraph only work when the in- 
volved reactions are close to equilibrium. Most in vivo biochemical reactions, 
however, are maintained far from equilibrium. The [ATP]/[ADP] ratio, for 
instance, is maintained very far above the Boltzmann equilibrium in a living 
cell. But there are examples of balances that stay close to a zero potential. For 
chloride and potassium, for instance, the electrochemical potential difference 
between intracellular and extracellular free ions is close to zero. However, lo- 
cally there are are strong fluctuations of the electrical potential (about 10 mV 
[5, 6j), which are mostly due to the opening and closing of sodium channels. 
These fluctuations can cause the membrane passage energy of chloride and 
potassium to fluctuate strongly and the right environment may be created 
for the above described effects to occur. 
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Abstract. A thermodynamics of Brownian motors working in contact with a single 
thermal bath is developed. The First and Second Law of Thermodynamics are 
derived from the Fokker-Planck equation of an arbitrary overdamped Brownian 
particle in a periodic potential changing in time. We also study Brownian motors 
in the adiabatic limit, introducing reversible ratchets which can transport particles 
with zero entropy production. As an application, we calculate the efficiency of 
motors based on the sluice ratchet 



1 Introduction 

How does a Brownian system exchange energy with the environment? The 
interest in this question has increased in the last years, mainly because it has 
been recognized that thermal fluctuations play an important and probably 
constructive role in biological energy transducers, the so-called protein or 
molecular motors. 

In Physics the issue has been addressed by Feynman [5,8] in a differ- 
ent context: the possibility of a ratchet that extracts energy out of thermal 
fluctuations. 

The energetics of a Brownian particle looks rather trivial at first sight. 
A Brownian particle is, by definition, in contact with a thermal bath. The 
particle exchanges energy with the bath via fluctuations and dissipation. 
Fluctuations tend, in average, to increase the energy of the particle, whereas 
dissipation is an energy flow which always goes from the particle to the ther- 
mal bath. In equilibrium these two flows of energy cancel each other and the 
mean energy of the particle remains constant. 

In order to have a less trivial behaviour one must drive the system out 
of equilibrium. In this paper we consider the following setup for a Brownian 
motor; a Brownian particle at temperature T in a periodic potential, which 
is changed by some external agent, and is adso subject to some external and 
constant force. 

Protein motors, such as kinesins, myosins or ion pumps in the cell mem- 
brane, fit into the above description. They move small particles against a force 
and can be considered as a Brownian degree of freedom x{t) in a potential 
determined by the shape of a protein. Depending on the type of motor, the 
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degree of freedom is the position of the protein itself or the position of an ion. 
ATP hydrolysis changes the shape of the protein and consequently changes 
the potential [3,7]. Therefore, the external agent in this case is a chemical 
reaction driven by non-equilibrium concentrations of ATP and ADP. 

Along this paper, we discuss the energetics of the Brownian motors de- 
scribed above. Most of our results are model-independent, and therefore can 
be applied to biological protein motors. 

The paper is organized as follows. We present in Sect. 2 the mathematical 
model of the motor. In Sects. 3 and 4 we derive, respectively, the First and 
Second Law of Thermodynamics from the Fokker-Planck equation, and we 
apply both, in Sect. 5, to find an upper bound for the efficiency of the motor. 
Section 6 studies the adiabatic limit, and the concept of reversible ratchet 
is introduced. In Sect. 7 we calculate and discuss the efficiency of reversible 
ratchets and, finally, we present our conclusions in Sect. 8. 

2 Brownian Particles in a Field 

Consider an overdamped Brownian particle positioned in the interval [0,L] 
at temperature T and within a potential V (x, t) periodic in space with period 
L, i.e., V{L,t) = P(0, f). We consider also an external and constant force F 
acting on the particle. The Langevin equation for the position x{t) reads: 

±{t) = K[-v'{x,t)+F+m\ (1) 

where the prime denotes derivative with respect to x and k = D/{kT), D 
being the diffusion coefficient and k the Boltzmann constant^. The stochastic 
force ^{t) is a white Gaussian noise with zero mean and correlation given by: 

{^{t)^{t')) = 2kTK-^S{t - t') = 2DK-^6{t - t'). (2) 

The Fokker-Planck equation for the probability distribution P{x, t) can be 
written as: 

dtP{x,t) = -dxJ{x,t) (3) 

where J{x,t) is the current: 

J{x,t) = K[-V'{x,t) + F]P{x,t) - Dd^P{x,t). (4) 

The distribution P{x, t) must also satisfy the following boundary conditions: 

P{0,t) = P{L,ty, J{0,t) = J{L,t). (5) 

The relationship between the current and the velocity will be important 
later on. Integrating the current (4) over the interval [0,L], one finds: 

dx J{x,t) = K{—V'{x,t) + F) (6) 

^ The Einstein’s fluctuation-dissipation relation states that k is equal to the inverse 
of the friction coefficient, i.e., the damping force is Fdamp = —x/k. 
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since the integration of the term proportional to T vanishes due to the peri- 
odicity of P{x,t). Averaging the Langevin equation (1) we conclude that the 
mean value of the velocity is the integral of the current: 




dx J{x, t). 



(7) 



This expression must be taJcen with some caution since (x(t)) can be different 
from the time derivative of {x{t)): 




dxxdtP{x,t) = — / dxxdxJ{x,t) 

Jo 






( 8 ) 



and they coincide if and only if the current vanishes at the boundary. The 
derivative of the average position does not take into account that the par- 
ticle can cross the boundary x — L and is then re-injected in the interval 
[0, L] through a: = 0. For instance, consider the case where V{x, t) = 0. The 
mean velocity is (i) = kF, but the particle soon reaches a stationary regime 
where the probability distribution P{x,t) is uniform. Then, the mean value 
is constant and located at the middle point of the interval, i.e., {x{t)) = L/2. 



3 The First Law- 



Let us discuss the energetics of the system. As internal energy we only con- 
sider the periodic potential: 

U{t) = j dxV{x,t)P{x,t) = {V{x,t)). (9) 

Jo 

The external force does not contribute to the internal energy, but it performs 
work adding or extracting energy. The work done by the force on the particle 
per unit of time is the force times the mean velocity, i.e.: 



W(t) = 




dx F J{x, t) 



( 10 ) 



and it is the energy entering into the system via the external force F. 

The particle also gains or releases some energy due to the changes of the 
potential V{x,t), i.e., there is an energy exchange between the particle and 
the external agent which modifies the potential. Although the energy that the 
external agent introduces into the system could also be considered “work” 
in the thermodynamical sense, we separate it from the work W done by the 
external force. In the biological examples discussed in the introduction, the 
work done by the external agent is in fact the “fuel” of the Brownian motor. 
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Then, we call input energy the work done by the external agent, reserving 
the term “work” only for the energy introduced by the external force into 
the system. The input energy is then given by: 

E[n{t) = f dxP{x,t)dtV{x,t). (11) 

Jo 

Finally, there is a transfer of energy from the thermal bath to the system, 
which is given by: 

Q{t)= [ dx [y (a:, t)dtP{x, t) - FJ{x, t)] . (12) 

Jo 




Fig. 1. Diagram of the energetics of the Brownian motor. The arrows indicate 
the direction of the flow when the corresponding energy transfer, W, Q or Fin, is 
positive, i.e., when energy enters into the motor 



Figure 1 represents the three energy flows that we have considered. From 
the above definitions, it is straightforward to prove the First Law: 

^^ = Q{t) + W{t) + E;„{t) foralH. (13) 

Notice that we reserve the dot only for quantities that cannot be written as 
the time derivative of a function. This is the case of heat, work, and input 
energy and it is equivalent to the fact that heat and work are non exact 
differentials in Thermodynamics. 

The above definitions of heat (12) and input energy (11) are easily justified 
for F = 0. They can be found for instance in [4]. As discussed in Ref. [9], 
they naturally come out when one considers abrupt changes of the potential 
V{x,t). The idea is that the external agent provides the energy to change the 
potential, whereas the thermal bath provides the energy for the subsequent 
relaxation of the probability distribution. 

For F ^ 0, the definition (10) for W{t) follows from the mechanical defi- 
nition of work done by a force. The definition (12) of heat Q{t) can be derived 
with the following argument: take the particle moving in the whole real axis 
(—00 < y < oo) in the potential V{y,t) — yF, with V{y,t) the periodic ex- 
tension of V{x,t)\ apply the definitions of heat and work given in [4] or [9]; 
then go back to the interval [0,L] by taking x = y mod L. 
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4 The Second Law 



In this section we derive the Second Law of Thermodynamics for the Brow- 
nian motor. First, we take the usual definition of the entropy of the motor: 

S{t) = —k f dx P{x,t)\nP{x,t) = —k{\nP{x,t)). (14) 

Jo 

It is convenient to write the current (4) in terms of the chemical potential 
p[x,ty. 

J{x,t) = -KP{x,t)[dxfj.{x,t) — F] (15) 

with 

fj.{x,t) = V(x,t) + kTlnP{x,t). (16) 

The average of the chemical potential is: 

{p{x,t))^U{t)-TS{t) (17) 

as expected (remember that the chemical potential is the Gibbs free energy 
per particle, and the Gibbs free energy is equal to the Hemholtz free energy 
if the particle is in a confining potential). Taking the time derivative of (17) 
we get: 

= (18) 

On the other hand, the time derivative of the average chemical potential can 
be written as 

* d 

— {p.{x,t))= J dx P{x,t)dtn{x,t) + J dx p.{x,t)dtP{x,t). (19) 

This equation can be further simplified. First notice that (5j In P(a;, t)) is 
zero, since the norm of P{x, t) is constant. Using the Fokker-Planck equation 
(3), one has: 



d • 

— {fj,{x,t))=Ein{t)-J dx fj.{x,t)dxJ{x,t). (20) 

Integrating by parts and taking into account that p{L)J{L) — ^(0) J(0): 

— {p,{x,t))=Ein{t) + J dx J{x,t)dxfj.{x,t). (21) 

The second term can be transformed as: 

pL plj 

/ dx J{x,t)dxli{x,t) —W / dx [dxli{x,t) - F]J{x,t) 

Jo Jo 

= W~n dx [dxfJ'ix, t) — rf' P{x^ t) (22) 

Jo 
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where we have used the relationship between the current and the chemical 
potential given in (15). Combining (18), (20), and (22), one finds: 

^W(t) - T^S{t) = Ei^ + W- TSprod (23) 

at at 

with 

S^roait) = ^ - F]^) , (24) 

which is non negative. Using the First Law (13), (23) can be written as: 

^S(i) - ^ = Sprodit) > 0. (25) 

This is the Second Law of Thermodynamics. The l.h.s of the equation contains 
two terms: the first one, dS/dt, is the increase of the entropy of the system; 
the second one, —Q/T, is the increase of the entropy of the thermal bath. 
Then, the sum 5prod is the increase of the entropy of the universe or entropy 
production per unit of time, which we have proved to be positive. 5prod 
vanishes only in equilibrium, i.e., only if both the external force F and the 
gradient of the chemical potential vanish. 



5 Efficiency 



Consider now a cyclic motor, i.e., a potential V (x, t) periodic in time with 
period r: V{x,t + T) = V {x, t). The system, after a number of cycles, reaches 
a stationary regime where P{x, t) and every state function, like the entropy 
S{t) or the internal energy L({t), are periodic in time. The system works as a 
cyclic motor when: 

W = f dtW(t) (26) 

Jo 

is negative, i.e., when the particle moves against the force. This is possible in 
some potentials which are usually termed as ratchets. Ratchets exhibit a non 
zero current in the absence of the external force F. If F is small enough, the 
particle can still move against the external force and W is negative. There 
is a stopping force Fgtop which suppresses the flow of the particle. Above 
.fstop) the particle moves in the same direction of the applied force and W is 
positive. 

Since the entropy S{t) is periodic, an integration the Second Law (25) 
along the whole cycle yields: 



Q = [ dtQ{t) = -T f dt5prod(0 < 
Jo Jo 



(27) 



i.e., there is an unavoidable dissipation of heat to the thermal bath (see Fig. 
1). The energy W is then provided by the external agent and therefore 

Ein = [ dtEin{t) 

Jo 



( 28 ) 
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is positive. From the First Law (13) and the periodicity of the internal energy 
one concludes that -W = + Q, i-e., part of the input energy is used to 

perform work against the force and part is dissipated to the heat bath. The 
efficiency of the motor is given by: 



^in £'in 



(29) 



which is smaller than one, due to (27). The Second Law, as expected, im- 
poses an upper bound to the efficiency of a Brownian motor. What we have 
presented is, in fact, a proof of the compatibility between the Langevin and 
Fokker-Planck approaches to the Brownian motion and the two laws of Ther- 
modynamics. 

The same proof of compatibility, for F = 0 and for underdamped particles, 
can be found in [12]. It is worth also to mention that the inequality (25) can 
be violated if the external agent possesses information about the position of 
the particle and modifies the potential according to this information. This 
can happen in macroscopic systems undergoing symmetry breaking phase 
transitions as we have shown in [11], in close relation with the Maxwell demon. 



6 The Adiabatic Limit: Reversible Transport 

In the previous sections we have derived relationships and inequalities for the 
three types of energy transfer: Q, W, and E-,„. In this and the following sec- 
tion, we explicitly calculate these quantities in the adiabatic limit, i.e., when 
the potential is changed infinitely slowly. This limit is interesting, not only 
because it allows us to find exact and analytical expressions for the energetics 
of the motor, but also because the motor works close to equilibrium, i.e., with 
maximum efficiency. 

Let us start with F = 0. In this case, the work W [t) is obviously zero, 
but we can still calculate the current J{x,t) which will be useful to obtain 
W (f) later on. 

At first sight, the adiabatic limit looks trivial. At any time t, the system 
is in equilibrium with the potential V{x,t), i.e., the probability distribution 
is: 

where P = 1/ (kT) and Z- {t) is a normalization constant (the subindex will be 
clear below). For this probability distribution the current vanishes. However, 
the integral of the current along the cycle is different from zero for some class 
of motors called reversible ratchets [9, 10]. 

In order to prove it, let us now solve the Fokker-Planck equation up to 
linear terms in dtV{x,t). We introduce the correction (p{x,t) as: 



P{x,t)=P- (x, t)[l+ip{x, t)] . 



(31) 
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For this distribution the current reads: 

J{x,t) = —DP-{x,t)dx(p(x,t) (32) 

and the Fokker-Planck equation up to first order in dtV{x,t), is; 

dtP-{x,t) = DdxP-{x,t)dxip{x,t), (33) 

which determines (p{x, t) along with the periodic boundary condition (p{Q, t) = 
(p{L,t). A first integration of (33) yields: 

DP^{x,t)dx‘p(x,t) = -J{L,t) + f dx' dtP-{x' ,t) (34) 

Jo 

where we have identified the integration constant with —J{L,t) using (32). 
Integrating this equation and imposing the periodic boundary condition, one 
finally finds the current at x = L: 

J{L,t) = f dx f dx' P+{x,t)dtP-{x\t) (35) 

Jo Jo 

where P+{x,t) is a new probability distribution: 

Z+ (t) being a normalization constant. 

In the adiabatic limit, the time derivative of P-{x,t) vanishes, and so 
does the current J(L, t). However, the integral of J{L,t) along the cycle [0 ,t] 
can be, in some cases, different from zero. We define the integrated flow as; 

(f)o= [ dtJ{x,t), (37) 

Jo 

which does not depend on the point x. Therefore, 4>o can be calculated inte- 
grating with J{L, t) as given by (35). We call reversible ratchets those systems 
where the integrated flow is different from zero. They exhibit reversible trans- 
port, i.e., the particle moves toward a direction and nevertheless is in equilib- 
rium at any time. There is a trivial example of this phenomenon discussed in 
Ref. [6], namely, a Brownian particle in a confining potential which is shifted 
infinitely slowly. It is worth to mention also that a slow modulation between 
two potentials Va{x) and Vb{x), i.e., ilV{x,t) = r{t)VA{x) + [l-r{t)]VB{x], 
with r{t) a periodic function oscillating between 0 and 1, can never be a re- 
versible ratchet. This is proved by means of the change of variable t -> r(f) 
in the integral (37). Notice that this is the case of the flashing ratchet [2]. 
In order to have a non trivial reversible ratchet, the potential V {x, t) must 
depend on two or more parameters and it must describe a loop in the space 
of parameters [9]. We present an explicit example below (see Fig. 2). 
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The input energy E\n in the adiabatic limit also vanishes for F = 0. The 
reason is that 

-Bin = [ dxP^{x,t)dtV(x,t) = -kTdtlnZ-{t) (38) 

Jo 

is an exact differential and therefore the integral along [0, r] is zero (remember 
that Z-{t) is periodic). The dissipated heat also vanishes along the cycle 
due to the First Law. Consequently, a reversible ratchet exhibits transport 
without any energy consumption and without heat dissipation. 

In the next section, we will need the first correction of the input energy. It 
can be calculated using the correction tp(x, t) defined by (31). The calculation 
is cumbersome but straightforward. The result is: 

Bin = b/T (39) 



with 



b = 

+ 



dtZ_(t)Z+(t){j(B,f)2 

lo i: dx' dx" [dtP-{x,t)] P+{x',t)[dtP-ix",t)]] 



(40) 



which is finite in the adiabatic limit (provided that dtV{x,t) is of order 1/t 
for all t). We see that the input energy is of order 1/r . Since W = 0, then 
Q — —Bin and therefore the Second Law implies that 6 > 0. This can also be 
proved by manipulating (40). 



7 Efficiency of Reversible Ratchets 

To build a Brownian motor from a reversible ratchet we must apply a small 
external force B. The Fokker-Planck equation (3) can be solved up to first 
order of B and 1/r [10] and the integrated flow reads: 

4> = <l>o + vtFL (41) 

where 

which can be interpreted as an average mobility of the Brownian particle in 
the potential V{x,t). The work is IT = FL<j> and it is negative only if F 
is between zero and the stopping force Bjtop = —(po/i^rL). We see that the 
stopping force is of order 1/r {(f>o and i/ are finite in the adiabatic limit). This 
is expected, since the force is acting along the whole cycle [0, r] and induces 
a current J(x,t) of order F at any time. This current, when integrated over 
the cycle, yields a contribution of order Ft. Still, we can have a motor in the 
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adiabatic limit if F goes to zero as 1 /r. Notice however that this is possible 
only for reversible ratchets. 

Up to first order of F and 1/t, the input energy along the cycle is [10]: 

Ein = FL<f>o + bfr. (43) 



Therefore, the efficiency is: 



_ -FL{4>q + vtFL) (j>Qa + 

FL<l>o + hlT ~ </.qq + 6 

with a = FLt. This result is exact in the adiabatic limit and all the param- 
eters in the last equation are finite. 

Let us apply the previous theory to a concrete example. As a reversible 
ratchet we consider the following potential with L = 1 (see Fig. 2a): 



V{x,t) 



Vi(t) if X < a 

0 if a<2;<l— a 

U 2 (t) if 1 - a < X < 1 . 



(45) 



The temporal evolution of Vi{t) and V 2 {t) is shown in Fig. 2b. In each 
step, one of them varies between and Umax at a constant velocity 

8U/ r. The shape of the potential at four points of the cycle is represented in 
Fig. 2c. The ratchet works as a sluice and is a possible model for biological 
ion pumps. 

For the sluice ratchet one can calculate (j>o, u, and b using (37), (42), and 
(40) respectively. The integrated flow <^o is positive as expected by simple in- 
spection of Fig. 2c. We then consider negative external forces. Fig. 3a depicts 
analytical results of the efficiency as a function of a = |F|r in the adiabatic 
limit and for a = 0.25, Umax = 5, and D = k = kT = 1. 

In the same figure we have plotted the efficiency of a random version of the 
sluice ratchet, which is not adiabatic but can still be treated analytically. The 



V, 



a) 



V, 





7\ 


12 

L_1 rr\ 


y 


— 1 




c 


- 


^ /■ 


) 







b) 



c) 



© 




© 









I I 




Fig. 2. An example of reversible ratchet: the sluice ratchet. The potential is depicted 
in a) and b) represents how the parameters Ui and U 2 vary along the cycle. Finally, 
c) shows the shape of the potential corresponding to the four states labelled in b) 
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a a 

Fig. 3. Efficiency r] of the sluice ratchet as a function of a = |F|r, for a = 0.2, 
Vmax = 5, and kT — D = \. We present analytical results for a) the adiabatic limit 
and b) random jumps between the corners of the square in Fig. 2 with r = 4/a; = 1 
(thin solid), r = 2 (dashed), r = 10 (long dashed), and r = 40 (thick solid). 



potential now randomly jumps among the four states, Vi{x) {i = 1,2, 3, 4), 
at the corners of the cycle in Figs. 2b and 2c. The system is described by 
the probability distribution Pi{x,t), which is the joint probability density for 
the position x of the particle and for the state of the potential i. The rate 
equation for this distribution is: 

4 

dtPi{x, t) = -Kdx \-Vl{x) + F - kTdx] Pi{x, i) + ^ t) (46) 

1=1 

where ojji is the transition rate from state j to i. To compare with the re- 
versible motor, we set W 12 = u) 2 Z = W 34 = W 41 = w and uiji — 0 otherwise. 
Then the potential describes a similar trajectory as the one depicted in Fig. 
2 with a random waiting time in each corner of the square. The mean value 
of the time to complete a cycle is r = 4/w. Analytical results of the efficiency 
are plotted in Fig. 3b, Comparing with the adiabatic motor, the efficiency 
decreases dramatically from 40% to 1.5%. The reason is that the system is 
far from equilibrium after each jump. We then conclude that adiabaticity is 
a necessary ingredient to reach high efficiencies. 

These results differ completely if we consider irreversible ratchets. In Ref. 
[10] we have calculated the efficiency of the flashing ratchet [2] in two cases: 
a) when the ratchet potential is continuously modulated, b) when the ratchet 
potential is randomly switched on and off. The efficiency is similar in the two 
cases and below 5%. 

8 Conclusions 

We have presented general results for the energetics of a wide class of Brow- 
nian motors, those consisting of a potential deterministically modified by 




Thermodynamics of isothermal Brownian motors 



49 



an external agent. We have derived the First and Second Law of Thermo- 
dynamics from the Fokker-Planck equation and also calculated exactly the 
efficiency in the adiabatic limit. In this limit, only reversible ratchets can 
work as motors, exhibiting comparatively high efficiencies. 

For the protein motors described in the introduction, two are the messages 
which can be extracted from the results presented here. A motor with high 
efficiency (above or around 30%) has to satisfy the following: 

• The shape of the protein must change describing a loop in some abstract 
space of parameters, since the interaction potential between the protein 
and the degree of freedom of the motor has to be a reversible ratchet. 

• The protein must change in a continuous way, avoiding abrupt jumps 
between stable or metastable states. 

We believe that any model of efficient motor must accomplish these two 
prescriptions. Still, for a direct application of the results of the present work to 
biological systems, a chemical coordinate driving the change of the potential 
should be included. This coordinate would evolve stochastically with a bias 
depending on the concentration of some “fuel” reactants, such as ATP and 
ADP. Work in this direction is in progress. 

This work has been supported by the Direccion General de Ensenanza 
Superior (DOES, Spain), grant PB-97-0076-C02. 
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Abstract. A pedagogical introduction to basic physical and mathematical con- 
cepts of stochastic modeling is given for the specific example of a rocking ratchet 
system. Perturbative methods axe illustrated by deriving the leading order behavior 
of the particle current for asymptotically fast rocking forces. 



1 Introduction 



In a spatially periodic system subjected to thermal equilibrium fluctuations, 
no systematic preferential direction of the random dynamics in one or the 
other direction can occur even if the spatial symmetry of the system itself is 
broken. At first glance, this fact is indeed astonishing, on the other hand it 
is merely a specific case of the no-go theorem for a perpetuum mobile, i.e. of 
the second law of thermodynamics [1,2]. 

The next surprise, called ratchet- effect, arises if such a spatially periodic 
system with broken inversion symmetry is driven away from thermal equi- 
librium: Even in the absence of any macroscopic static forces, gradients (of 
temperature, concentration, chemical potentials etc.), or biased time depen- 
dent perturbations, the appearance of a systematic preferential direction of 
the random dynamics is the rule, its non-appearance the exception. Here the 
word “macroscopic” refers to “coarse grained” effects that manifest them- 
selves over many spatial periods of the system. Such a generic occurrence 
of the ratchet-effect has been explicitly demonstrated in a large variety of 
non-equilibrium systems, both theoretical and experimental, as reviewed in 

[3-5]. 

In the following sections we present on an elementary level the physi- 
cal background of stochastic modeling as well as the typical mathematical 
strategies of solution. As an illustrative example serves the one-dimensional 
overdamped rocking ratchet model, considered previously in several theoret- 
ical works [6-11]. In [12] it has been pointed out that the phase across an 
asymmetric SQUID (superconducting quantum interference device) threat- 
ened by a magnetic flux may be modeled by such a rocking ratchet dynamics 
and a modified version of this setup has been realized experimentally in [13]. 
The quantum mechanical version has been worked out theoretically in [14] 
and realized experimentally in [15]. 



J.A. Freund and T. Poschel (Eds.): LNP 557, pp. 50-60, 2000. 
(c) Springer- Verlag Berlin Heidelberg 2000 
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2 Rocking Ratchet Model 

One of the simplest working models for studying the ratchet effect consists 
of the one-dimensional Brownian dynamics of a particle with coordinate x(t) 
and mass m, which is governed by Newton’s equation of motion 

mx(t) + V'(x(t)) - f{t) = -rjx{t) + . (1) 

Here V (a;) is a periodic potential with period L, 

V(x + L)= V{x) , (2) 

and broken spatial symmetry, i.e. there exists no Ax such that V{-x) = 
V{x + Ax) for all x. A typical example for such a ratchet potential is 

V{x) = Vo [sin(27ra;/iy) -f 0.25 sin(47ra:/L)] . (3) 

The left hand side in (1) accounts for the deterministic, conservative part 
of the particle dynamics, while the right hand side represents the effects of a 
thermal environment. These are energy dissipation, modeled in (1) as viscous 
friction with friction coefficient tj, and randomly fluctuating forces in the form 
of the thermal noise ^(t). 

The external driving f{t) in (1) is assumed to be T-periodic, i.e. 

fit+T) = m, (4) 

hence the name rocking ratchet [7]. A typical example is 

f{t) — A sin{fit) , T — 27r/f? . (5) 

In the absence of the driving force /(t), the dynamics (1) represents a thermal 

equilibrium system, not admitting any preferential direction of the particle 
motion x{t). In the presence of f{t), the system is permanently kept away 
from equilibrium, and, as mentioned in the introduction, this should be re- 
alized without biasing the system a priori in one or the other direction, i.e., 
we require that 

dtf{t)=t). (6) 

The quantity of central interest is the average particle current per driving 
period 

(^) ~ f 

where (•) indicates the average over independent realizations of the random 
process ^(t) in (1). Furthermore, we will focus on the behavior of this current 
in the long-time limit t ^ oo, i.e. after all initial effects have died out. This 
long time limit of the current can be identified, due to ergodicity reasons. 
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with the time averaged velocity of a single realization x{t) of the stochastic 
dynamics (1), i.e. with probability 1 we have that 



(x) = lim 

' ' t-^oo 




( 8 ) 



independent of the initial condition x(0). 



3 Gaussian White Noise 

The two terms on the right hand side of (1) are not independent, they have 
both the same origin, namely the interaction of the particle x{t) with a huge 
number of microscopic degrees of freedom of the thermal environment. By our 
assumption that the dissipative interaction with the environment is modeled 
by the first term on the right hand side of (1), also the statistical properties 
of the random thermal noise ^(t) are already completely fixed [16]: The fact 
that the dissipation is linear in x{t), i.e. no spatial direction is preferred, 
implies that - due to their common origin - also the thermal fluctuations are 
unbiased, 



m) = 0 ( 9 ) 

for all times t. Similarly, the fact that the frictional force only depends on the 
present state of the system a;(t), and not on what happened in the past, has 
its counterpart in the property that the random fluctuations are uncorrelated 
in time, i.e. 

m)as)) = o ift^s . ( 10 ) 

The fact that the friction involves no explicit time dependence has its corre- 
spondence in the time-translation invariance of all statistical properties of the 
fluctuations, i.e. the noise ^{t) is a stationary random process, and especially 
independent of x{t): 

= 0 ( 11 ) 

for all t and s. Finally, the fact that the frictional force acts permanently in 

time indicates that the same will be the case for the fluctuations. In other 
words, a noise ^{t) exhibiting rare but relatively strong “kicks” , caused e.g. by 
impacts of single molecules in a diluted gas, is excluded. Technically speaking, 
one says that cannot contain a shot noise component [17]. During a small 
time interval, the effect of the environment thus consists of a large number 
of small and, according to (10) practically independent, contributions. Due 
to the central limit theorem [18], the net effect of all these contributions on 
the particle x{t) will thus be Gaussian distributed. Such a Gaussian random 
process which is unbiased (9) and uncorrelated in time (10) is called Gaussian 
white noise. 
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4 Fluctuation-Dissipation Relation 
and Einstein Relation 

Choosing V{x) = 0 and f{t) = 0 one can easily integrate the linear dy- 
namics (1). Taking furthermore into account that in the long time limit the 
equipartition principle 

771 1 

■^{^Ht)) = ^kBT , ( 12 ) 

must be satisfied, a straightforward calculation yields the so-called fluctuation- 
dissipation-relation 



{mas)) = 2rikBTS{t-s) , (13) 

where 6{t) is Dirac’s delta function. 

In the absence of the potential V{x) in (1), we know that the particle x{t) 
exhibits a free thermal diffusion in one dimension with a certain diffusion 
constant D, i.e. for asymptotically large times t we have that 

{x‘^(t))=2Dt . (14) 

On the other hand, by multiplying equation (1) by x{t) and averaging, we 
obtain 

d 

m {x{t)x{t)) = m —{±{t)x{t)) - m {x^{t)) = -rj {x{t)x(t)) , (15) 

where we have exploited (11) in the last identity. By differentiating (14) we 
have (for large t) that {x{t)x{t)) = D, hence d{x{t)x{t))/dt = 0. Observing 
(12) we finally obtain from (15) the so-called Einstein-relation 



D = ksTfr} . 



(16) 



5 Overdamped Limit and Fokker-Planck Equation 

For the typically very small systems one has in mind and for which thermal 
fluctuations play an appreciable role at all, inertia effects are usually negligi- 
ble, i.e. we can omit mx{t) in (1) and obtain the overdamped rocking ratchet 
model 

T] x(t) = -V'(x(t)) -h f(t) -h^(t) . (17) 

Next, we introduce a statistical ensemble of stochastic processes (17), 
belonging to independent realizations of the random fluctuations ^(t). The 
corresponding probability density P{x,t) describes the distribution of the 
Brownian particles and follows as an ensemble average (or, equivalently, as 
an average over the noise) of the form 



P{x,t) := {5{xit)-x)) . 



(18) 
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An immediate consequence of this definition is the normalization 



/: 



dx P{x, t) = 1 



(19) 



Another trivial consequence is P{x,t) > 0 for all x and t. 

To determine the time-evolution of P(x,f), we first consider in (17) the 
special case that V'{x) = 0, f(t) = 0, corresponding to free diffusion with 
diffusion constant D, see equation (14). Consequently, P{x,t) is governed by 
the diffusion equation 

^^P{x,t)=D^P{x,t) , [V'{x) = 0, f{t)=0]. (20) 

Next we address the deterministic dynamics ^{t) = 0 in (17). In complete 
analogy to classical Hamiltonian mechanics, one then finds that the proba- 
bility density P{x, t) evolves according to a Liouville-equation of the form 






V'{x)-t(t) 



P{x 



,^)} , 



m = 0 ] . ( 21 ) 



Since both (20) and (21) are linear, it is quite obvious that the general case 
follows by combination of both contributions, i.e., one obtains the so-called 
Fokker-Planck equation [18] 



dt 






6 Reduced Density and Particle Current 

Obviously, the probability density P{x,t) contains the entire information 
about the system, so the question arises of how to extract the particle current 
(7) out of it. This connection between (i) and P{x, t) follows by averaging 
in (17) and taking into account (9), i.e., rj{x{t)} = (/(t) — V'{x{t))). Since 
the ensemble average (•) means by definition an average with respect to the 
probability density P{x, t) we obtain 

* Jo J — cx> ^ 

Next, we introduce the so-called reduced probability density 

oo 

P{x,t) := ^ P{x + nL,t) 

n=—oo 

Taking into account (19), (24) it follows that 



(23) 

(24) 
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With P{x, t) being a solution of the Fokker-Planck equation (22) it follows 
from (2) that also P(x + nL, t) is a solution for any integer n. Since the 
Fokker-Planck equation is linear, it is also satisfied by the reduced density 
(24) and can be recast into the form of a continuity equation: 

^P(x, t) + ^J(x,t) = 0 , (26) 

where the reduced probability current is defined as 

(27) 

Furthermore, the particle current (23) can be rewritten as 

(x) = ^ [ dt f dxJ{x,t) . (28) 

I Jo Jo 

Due to the permanent oscillations of f{t), the Fokker-Planck equation (26) 
with periodic boundary conditions (25) does not admit a time-independent 
solution. Hence, the density P{x,t) will not approach a steady state but 
rather a unique periodic behavior in the long time limit. To see this, we 
note that since f{t + T) = f{t) it follows that with P{x, t) also P{x, t + T) 
solves (26). Moreover, for the long time asymptotics of (26) the general proof 
of uniqueness from [18] applies. Consequently, P{x,t -f T) must converge 
towards P{x,t), i.e. P{x,t) is periodic and unique for t ->■ oo. 

In other words, it suffices to solve the Fokker-Planck equation with periodic 
boundary conditions in time and space. 



7 Fast Rocking Asymptotics 

The present section has two purposes. First, it exemplifies in detail the typical 
procedure of solving the Fokker-Planck equation perturbatively in the case 
that some parameter of the model becomes small. Perturbative treatments of 
other ratchet models which are similar to ours in the general spirit, though 
rather different in the technical details, can be found for instance in [19, 20]. 
Second, the specific asymptotics which we shall consider here, namely that 
of small periods T in (4) (high frequencies, see (5)), has turned out to be 
rather obstinate against analytical approximations. Attempts have been made 
[10, 11] but cannot be considered as fully satisfactory. Numerical results, on 
the other hand, show [7] as a quite remarkable feature that in the fast rocking 
regime, the “natural” current direction (i.e. the one realized for “simple” 
potentials V{x) sufficiently similar to an asymmetric saw-tooth potential, 
like e.g. in (2)) is just opposite to the one for slow rocking. While the slow 
rocking limit is well understood [7], the fast rocking limit is not. 
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7. 1 Transformed Dynamics 

We assume that the T-periodic function f(t) in (17) is of the form 

f{t) = vfo(t/T) , (29) 

where /o(t) is a T-independent function of its dimensionless argument r, see 
for instance (5). Next we introduce 

X{t)~x{t)-Tfi{t/T) , (30) 

where the functions /i(r), i = 1,2, ... are defined by the recursion 

( dTfi_i{T)+ f dTT/i_i(r) . (31) 

Jo Jo 

With (4,6) it readily follows for i = 0, 1, ... that 

/i+i(r) = Mr) , Mr + 1) = Mr) , Ti ■= f' dr Mr) = 0 . (32) 

Jo 

Next, we can infer from (17), (30) that 

X(t) = -U'{X(t) + TMt/T)) + 5{t) , (33) 

where 

U{X) := V{X)M (34) 

and where E(t) := ^{t)/rj is a Gaussian white noise with correlation 

{S{t)E{s)) = 2DS(t-s) . (35) 

Thus, the Fokker-Planck equation equivalent to the stochastic dynamics (33) 
for the reduced probability density P{X, t) reads 

d d 

where the reduced probability current is defined as 

J(W,f):=-|[7'(X-r/i(t/r))+D A| P(x,t) (37) 

and the particle current is given by 

{X) = ^[ dt f dXJ(X,t). (38) 

' Jo Jo 

Exploiting (32) and the self-averaging property (7) of the particle current, 
we can infer from (30) that 

(i) = {X) . (39) 
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So, as far as the particle current is concerned it is sufficient to focus on the 
X-dynamics (33) from now on. 

After expanding on the right hand side of (33) 

U'{X{t) + Th(tir)) = , (40) 

*=o 

one sees that in comparison with (17) we have “gained” one order of T, 
the “perturbation” in (40) is of leading order T only. While the following 
calculations could also be carried out by directly starting with (17), the latter 
fact brings along an enormous practical advantage of the transformed problem 
(33) as far as calculational efficiency is concerned. 

7.2 Perturbative Ansatz 

Our goal is to solve the Fokker-Planck equation (36) for large T perturba- 
tively in powers of T. The main non-trivial step which requires a certain 
amount of physical intuition is an appropriate ansatz for P{X,t). Following 
[21] we try an ansatz of the form 

OO 

P{X,t) = '£T^Pn{X,t/T) , (41) 

n=0 

where the functions Pn{X, r) are assumed to be independent of T. Prom (25) 
and the periodicity in time for t f oo we can conclude that 

Pn{X + L,T) = Pn{X,T + l) = Pn{X,T) , dX P„ ( A, t) = <5„,o (42) 

Jo 

for n > 0, where Jj,* is the Kronecker delta. 

Introducing the ansatz (41) and the expansion (40) into the Fokker-Planck 
equation (36) and observing that this equation is supposed to hold for arbi- 
trary T it follows that the coefficient of each power of T must be equal to 
zero separately, i.e. 

|:P„(A,r)-f-^J„_i(A,r)=0, (43) 

for n > 0, where we have introduced 

J„(A,r) :=-f^^[/<''+i)(X)P„_,(A,r)-pAp„(x,r) (44) 

fc =0 

for n > 0 and where we have set J_i(X, r) := 0. 

For the average particle current in the long time limit (38), (39) we can 
conclude that 

OO 

(ar) 

n=0 



(45) 
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Here, the bar indicates a time-average over one period T (cf. (32)) and the 
X-independence of J„ can be readily inferred by time-averaging in (43) . 

Next, one has to solve (42), (43) step by step. We exemplify the typical 
line of reasoning for the lowest order n = 0: From (43), and J_i(X, r) := 0 
we have that 

^Po{X,r) = Q (46) 

and therefore 

Po(X,r) =ho(X) (47) 

with an unknown function ha{X). Introducing (47) into (44) and then aver- 
aging in (43) for n = 1 over one time-period T one obtains 



Jo = const 






(X) + D 



dX 



ho(X) . 



(48) 



Taking into account the conditions (42) it follows that 







^-U{X)/D 



(49) 



and that 

X = 0 . (50) 

Hence, in zeroth order T, the particle current (45) vanishes, as one might 
have expected. 

In the same way one proceeds to higher orders of T. Depending on tech- 
nical skills one finds after a few pages or several dozen pages of calculations 
that the particle current vanishes up to the order and that in leading 
order T it takes the form 



(x) = 



L z 



Z := 2 /I £ dx V'{x) [V"'ix)f ([^"'(^)]' 

J\x (|[y"'(x)]'* + 



/o/l 



2kBT 



(51) 



2kBT ) 

(52) 



where we have exploited (16) and (34) in order to return to quantities of the 
original dynamics (17) and where we have used the relations (29), (31), (32). 

We remark that the limits T ->■ 0 and T 00 do not commute, i.e. (51) 
is not valid for a fixed (however small) T if one lets T 00 . For this reason, 
the well known fact that (x) 0 for T 00 is not captured by (51) 
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7.3 Discussion 



With the leading order asymptotics of the averaged particle current for small 
driving periods T in (51) we have obtained our central result. Our first ob- 
servation is that the fast rocking ratchet is exceedingly reluctant to produce 
a current, all contributions up to the order are zero. This fact suggest 
that also a simple intuitive explanation of the current direction may be very 
difficult to figure out. 

If the driving f{t) in (17) is symmetric, i.e. there exists a At such that 
—f{t) = f{t -I- At), as for instance in (5), then the odd contributions in / to 
(52) vanish and we have 



Z\=2 




dxV'{x)[V"'{x)f . 



(53) 



For sufficiently simple potentials F(x), like for instance (3), the sign of the 
current in (51), (53) is dictated by that of the steeper slope of V{x), in 
agreement with the numerical findings in [7]. Remarkably, this sign of the 
current in (51) does not depend an any detail of the driving f{t) except that 
it should be symmetric. In the special case of a fast sinusoidal driving (5) 
with asymptotically small amplitude the result from [11] is recovered. 
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Abstract. Waves or pulses propagating along periodic structures cause thermally 
controlled transport of diffusing defects. The dragging waves/pulses may modulate 
the amplitude of the substrate as well as the geometry of the boundaries where 
the defects are confined. The transport efficiency of such a mechanism attains its 
maximum for an optimal value of the temperature and the modulation speed. 



1 Introduction 



The search for autonomous transport devices (i.e. operating in the absence 
of external macroscopic potential or temperature gradients) has enjoyed a 
surge of interest in the recent literature [l]-[4]. The device output current 
(rectified signal) is expected to stem from a cooperative effect of the tem- 
poral and spatial asymmetries that characterize the microscopic field(s) of 
force acting upon the diffusing particles. The most popular example is repre- 
sented by the so-called thermal ratchets: As apparent in many a biochemical 
process [1], undriven particles may eventually drift in a certain direction un- 
der the simultaneous influence of an asymmetric substrate potential and a 
time-correlated noise source, the latter implying, of course, a nonequilibrium 
coupling of the particles to their heat bath [2]. Thermal ratchets are remark- 
able devices capable of rectifying a zero-mean noisy signal. However, noise 
correlation time and degree of asymmetry are mostly built-in parameters and, 
therefore, the performances of such devices are hardly tunable at the exper- 
imenter’s needs {passive rectifiers). Ratchets have been proposed to rectify 
periodic signals, too {rocked ratchets [3]). Particle transport in the presence 
of zero-mean macroscopic gradients are more effectively achieved by combin- 
ing time and space asymmetry in the form of a travelling field of force that 
sweeps, for instance, through a homogeneous medium, where an assembly of 
massive particles sit afloat at finite temperature (Brownian surfers [4] under- 
going Stokes drift [5]): There exists a threshold value of the wave speed below 
which the floating particles can be dragged cdong by the incoming wave. Noise 
rectifiers based on this mechanism are nevertheless externally driven devices. 
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2 The Model 

In a recent paper [6] we studied the diffusion of an overdamped Brown- 
ian particle over a periodic symmetric substrate modulated in amplitude 
by (trains of) propagating pulses. Here we focus on the one dimensional 
cases of Fig. 1. The substrate potential is represented by a periodic poten- 
tial with amplitude Vq and wavelength 27 t; an amplitude modulation (AM) 
pulse is one cell 27 t wide and is modelled by -eV (n) over the m-th barrier 
X 6 [2m7T, 2(m -|- l)7r] (Fig, 1(a)) or by eV{x + tt) across the m-th potential 
valley x € [(2m - 1)7 t, (2m -I- 1)7 t], with m = 0, ±1, ±2, . . . (Fig. 1(b)). In our 
numerical simulations, the pulse amplitude AV — eVq was controlled by a 
multiplicative parameter e with 0 < e < 1 (i.e. the m-th barrier was lowered 
in case (a) and the bottom of the m-th valley was raised in case (b)). The 
propagation of a single pulse occurs stepwise, say, to the right, according to 
a regular time sequence of discrete unit shifts with length 27 t and time con- 
stant At, the correspondent average propagation speed of a single pulse is 
thus c = 2Tr/ At ^ 

The model proposed here was freely inspired by a variety of very diverse 
physical systems where a net output is driven by either periodic or random se- 
quences of pulses propagating along a predetermined substrate path. Pulses 
may modulate quantal barriers of electronic microstructures [7], chemical 
bonds of ligands migrating along macromolecular chains [8], defect depin- 
ning energies in zone refining techniques [9], confining walls in easy fluxon 
flow channels [10], optical tweezers [11] to mention but a few examples. Our 
thermal conveyer combines certain ingredients from thermal ratchets (diffu- 
sion -is quenched by the substrate potential) and Brownian surfers (diffusion 
is driven by travelling waveforms), cJike: In the stationary state, these two 
conflicting diffusion mechanisms determine the magnitude of the rectified 
current. In particular, we prove that the conveyer transport current attains 
a maximum when plotted either against the system temperature (at fixed 
pulse speed) or against the pulse speed (at fixed temperature). Moreover, the 
device conveyance may be optimized by selecting an appropriate value for 
the temperature and the modulation speed. 

We consider, first, case (a) of Fig. 1. The Langevin equation that de- 
scribes the diffusion of an overdamped particle over an amplitude modulated 
substrate reads 



X = ~v'{x,m) + ^{t). 


(1) 


V{x,m) = Fo(l - cosx) + AV{x;m). 


(2) 



The stepwise propagation of the AM pulses makes a quantitative interpretation 
of our simulation results easier. Moreover, inherently discrete propagation sub- 
strates are very common in natural sciences (see e.g. crystal lattices and molec- 
ular chains). Anyway, we checked that thermal conveyers work effectively in the 
continuum limit m -4 t/ At, as well. 
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Fig. 1. Single pulse mechanism. A modulation pulse - of the substrate amplitude 
in (a) and the temperature in (b) - travels along a channel made of coaxial rings 
(a cross-sectional view of the device is shown). A ring (represented by a pair of 
solid squares) corresponds to an unperturbed potential barrier. Case (a): The am- 
plitude pulse (open square) AV = eVo lowers the relevant potential barrier. The 
resulting potential V(x,m) and the same potential after one discrete step to the 
right V(x,m + 1) are also displayed with their stationary probability distributions 
(dotted curves). Case (b): The vertical arrows represent an appropriate temperature 
pulse AT localized at the bottom of the m-th potential well. The corresponding 
potential is drawn as —V(x + n,m), with V(x,m) plotted in (a) 



Here, ^(t) denotes a Gaussian, zero-mean valued, stationary random noise 
with autocorrelation function (C(t)^(O)) = 2DS(t). The noise strength D 
scales proportionally to the system temperature. The AM potential V(x,m) 
is defined as follows: (a) the integer m represents the time variable t in units of 
the time constant At, i.e. m = lnt\tlAt\, (b) V (x) is meant to model a generic 
unperturbed substrate (i.e. periodic) potential. Here, spatial asymmetries 
play no role, so that for simplicity we adopted the cosine potential V (x) = 
Vb(l - cosx); (c) the travelling pulse AV(x-,m) is centered around the m-th 
barrier in [2m7r, (2m + l)7r], that is AV(x\ m) = -eV(x) 6>[2m7r] 0[-2(m -t- 
1)7t], where ©[x] is the Heaviside step function and 0 < e < 1. The numerical 
integration of Eqs. (l)-(2) was carried out by encoding standard algorithms 
for the solution of stochastic differential equations [4]. As a caveat we remark 
that numerical stability was achieved only after fairly long computer runs 
(see Figs. 2 and 3). 
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Fig. 2. Transport current j{D,At) (in rad/s) versus D for different values of the 
time constant At. Other simulation parameters are Vo = 1, N = 3 and e = 0.5; 
simulation runs of 10^^ integration steps h = 3 ■ 10“®s 



Case (b) in Fig. 1 corresponds to replacing AV (x; m) from case (a) with 
eF(x+7r) 0[(2m- 1)7 t] 0[-(2m + l)7r] or, in a more suggestive form, by turn- 
ing upside down the very same potenticd V{x,m) from case (a). Furthermore, 
reversing the sign of e would introduce two more topologically unrelated cases 
involving amplified barriers and very low conveyance. 

In order to enhance the system conveyance we stipulated that the trav- 
elling amplitude pulses form an ordered spatial array with spacing constant 
N -.that is, the incoming pulses can be arranged into a travelling AM wave- 
form with wave length 2t:N. However, random pulse sequences may also be 
invoked to interpret defect transport mechanisms on a periodic substrate [14]. 
Thus, for both types of pulse sequences the further question rises as how the 
rectified current depends on the pulse rate {NAt)~^. 



3 Simulation Results 

We discuss now the conveyance of model (l)-(2), namely of case (a), for a 
fixed value of A. In Figs. 2 and 3 we display the dependence of the probability 
current j{D,At) on D at fixed pulse speed (Fig. 2) and on At at fixed tem- 
perature (Fig. 3). In both cases we obtained resonance curves that peak at 
a certain value of the tunable observable. The asymptotic limits of j{D,At) 
can be intuitively explained: For At fixed and 0—^0 thermal diffusion over 
the potential barriers vanishes, hence j(0, At) = 0; for At fixed and 0 — oo 
diffusion becomes insensitive to the substrate amplitude and its modulations 
[12], so that j{D — f 00 , At) —t 0; For 0 fixed and At —t oo the relaxation 
process ensuing the pulse step forward m ^ m + 1 gets completed before 
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the subsequent step m + 1 — >-m + 2is taken. One can easily prove ^ that 
in the corresponding adiabatic limit j{D, At — > oo) tends to zero; finally, for 
D fixed and At 0 the perturbation speed is so fast with respect to the 
relaxation dynamics caused by the travelling pulses, that the AM potential 
boils down to a homogeneous effective substrate, where no drift may occur, 
i.e. j{D, At — t 0) = 0. The former two limits — > 0 and D -> oo for fixed 

At are reminiscent of stochastic resonance [15], whereas the latter two limits 
A — > 00 and At — ^ 0 for fixed D bear apparent similarities with the low and 
high frequency limits of the rocked ratchet current [3]. 




Fig. 3. Transport current j{D, At) (in rad/s) versus At for different values of the 
noise strength D. Other simulation parameters are Vb = 1, iV = 3 and e = 0.5; 
simulation runs of 10^^ integration steps /i = 310“®s 



The curves in both figures can be apparently embedded under an envelop- 
ing curve with a unique maximum for an optimal value of D and At. This 
means that the control parameters D and At can be tuned simultaneously 
so as to maximize the conveyance of our device (i.e. its transport capability 
or rectifying power). This is an important difference with respect to similar 
devices designed to exploit the stochastic resonance or the thermal ratcheting 
mechanism [16]. 

^ In the limit At — > oo the pulse propagation is regarded as an adiabatic process, 
where the Brownian particles are in equilibrium both immediately before and 
after a single pulse step forward has occurred. The time constant At is then 
assumed to be much larger than the escape time of the particles out of a potential 
well, namely At fik{D) <C 1 with (ik(D) ~ kb exp(— 2e*^Vb/D) and = 0, 1. In 
the opposite limit, the perturbation caused by a travelling AM pulse spreads 
out over many substrate cells, thus forming an exponentially decaying trail. For 
At — > 0 a new adiabatic limit is recovered, where the effect of the time dependent 
AM perturbation is equivalent to a static rescaling of the potential parameters. 





66 



M. Borromeo and F. Marchesoni 



An analytic interpretation of the main features of Figs. 2 and 3 is not 
trivial at all. In fact, the average impulsive force applied at each step forward 
of the AM pulse AV (x; m) cannot be advocated to explain the non vanishing 
value of j{D,At), no matter what the pulse rate; in fact {AV'{x-,m + 1) - 
AV'{x; m)) — 0. The finite conveyance of our device (l)-(2) is thus a diffusion 
controlled phenomenon. A reasonable estimate of the transport current can 
be figured out by inspecting Fig. 1(a), namely 



j{D.At) 



A-k Pi - Pq 
NA t Pi + Po 



exp 



1 

Atjj,{D) 



( 3 ) 



The quantities Pk = M e'icp[~s^V{x) j D]dx = 2-Kj\f I o[£^Vq / D], where 
k = 0,1 and Iq{x) is the 0-th modified Bessel function, denote the probability 
of finding the diffusing particle at the opposite sides of an unperturbed (Pq) 
or a lowered substrate barrier (Pi). The exponential weight factor accounts 
for the finiteness of the pulse speed relative to the Brownian relaxation rate 
H{D) = Ho{D) + Hi{D), where fik{D) is the Kramers’ rate over a regular 
{k = 0) or a lowered barrier (k = 1) [12]. The asymptotic limits P — 0, 
D ^ oo and At ^ oo At ^ 0 illustrated above are thus readily reproduced. 
Moreover, optimal conveyance is predicted for D ~ 2eVb and At fi{D) ~ 1, 
in close agreement with the numerical results of Figs. 2 and 3. 




4 




1 



0 



Fig. 4. (a) Transport current j{D,At) (in rad/s) versus D for At = 3.0, Vo = 
1, A = 3 and e = 0.5. The invariance of j under the symmetry transformation 
V(x,m) —V(x,m) is apparent within our numerical accuracy, (b) The scaled 
current Nj{D, At) (in rad/s) versus D for different values of N. Other simulation 
parameters are Vo = 1, At = 1.0 and e = 0.5 



The treatment of case (b) of Fig. 1 is straightforward if one makes use of a 
well established property of stationary Brownian motion: The relaxation dy- 
namics of (1) and (2) is invariant under the discrete transformation that turns 
the substrate potential upside down. The analytic proof of this statement for 
the system at hand follows immediately the Fokker-Planck approach of [12] - 
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[13]. On skipping the mathematical details of that proof, the reader is referred 
to the numerical evidence of Fig. 4(a): the conveyer current j{D, At) is ap- 
parently insensitive to the symmetry transformation V{x,m) —V{x,m). 
This means that our model may describe as accurately situations where, in- 
stead of lowering a substrate barrier like in case (a), a single cell is heated up, 
as customary in the zone refining techniques [9] (Fig. 1(a)). Moreover, our 
results suggest that zone refining may be quite effective even if the magnitude 
AT of the travelling temperature pulse is small compared to the stationary 
temperature T of the sample, provided that the refining procedure is repeated 
many times over. 

4 Discussion 

The estimate of j(D, At) in (3) is based on the assumption that each incom- 
ing modulation pulse propagates in an otherwise unperturbed environment; 
any cooperative effect among sequential pulses is discarded. Actually, for 
such a single pulse approximation to hold true, it suffices to assume that the 
Brownian diffusion over the time interval N At separating a pair of incoming 
pulses, is not appreciably larger than the distance 2TrN between them. In 
terms of overdamped diffusion in a periodic potential [12] this corresponds to 
requiring that 2Ds{NAt) (27riV)^, with Dg = {2n)'^fi{D), or equivalently, 
At p(D) < TV. The TV dependence of the current j{D,At) is illustrated in 
Fig. 4(b): For small values of the noise strength D, the scaling law j oc 1/TV 
predicted in single pulse approximation is confirmed, as the relaxation rate 
p{D) vanishes exponentially for 0. A substantial spread of the curves 
that represent Nj{D,At) versus D becomes detectable only for larger noise 
strengths (but not too large TV values). As anticipated in our introductory 
remarks, a random pulse sequence, too, is capable of driving a net current. It 
is now clear that in single pulse approximation its conveyance would be pro- 
portional to the pulse rate {N At)~^ , where 2nN denotes the average distance 
between two incoming pulses. 

For most practical purposes the passive rectifier (l)-(2) might have to be 
modified in order to account for the temperature dependence of the mod- 
ulation pulse flow. Let us suppose that our device is brought into thermal 
contact with a heat bath at temperature To corresponding to a unique value 
of the noise strength Dq = D(To); let the effectiveness of the device-reservoir 
coupling be measured by the current threshold jo'- If j(To,At) > jo the de- 
vice temperature T increases according to the linear law dT /dt oa j — jo , 
whereas if j (To , At) < jo the device is maintained in equilibrium with the 
heat bath at T = To. It seems reasonable to expect that the pulse speed 
increases monotonically with T — To as long as T > To; conversely, At(T) 
becomes a decreasing function of T. It takes a little thinking to prove that 
if j{To, At{To)) > jo, then the values of the control parameters T and At 
increase with time until they reach the stable working point of the device. 
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defined implicitly by the equation j\T, At{T)] = jo with T > To- Under these 
(oversimplified) circumstances our thermal conveyer (l)-(2) operates as an 
active rectifier. This rectification mechanism has potential application in the 
theory of thermo- regulated biochemical processes [8]. 

Finally, we notice that the transport mechanism illustrated so far applies 
to the case of modulated geometric boundaries, as well. Let us assume that 
an assembly of weakly interacting defects is free to move along a channel 
with periodic boundaries - see Fig. 1, where now the solid squares are meant 
to represent a spatial modulation of the channel cross section. A boundary 
wave/pulse (the open square in Fig. 1) corresponds to a symmetric, local 
deformation of the channel longitudinal section. In the absence of an external 
gradient no net defect current is to be expected (no matter what the auto- 
correlation of the thermal fluctuations), unless the boundary deformation is 
made translate in one direction. Under such a circumstance, a rectification 
mechanism may occur as a result of the collective interactions of the defects on 
the channel walls [17]. As a typical example we mention the case of magnetic 
vortices dragged along an easy-flow channel by a STM tip that sweeps the 
channel repeatedly in the same direction. 
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Abstract. When the properties of a medium, including its temperature, vary in 
space the familiar diffusion equation needs to be modified. It has been shown earlier 
that the modification is not universal but depends on the specific mechanism that 
causes the diffusion and three cases have been considered. This paper studies the 
effect of these modifications on the conduction in a wire in the presence of an 
external field. The conclusion is that the differences between them are rather minor. 



1 Introduction 

When particles diffuse in a medium whose properties and temperature are 
functions of the position r in space, the familiar diffusion equation cannot be 
applied. When they are subject to an external potential V{r) the particles 
in a hotter zone have the tendency to climb up on the potential slope. This 
phenomenon was pointed out by Landauer[I] who coined the name “blow- 
torch effect” for it. It can be understood thermodynamically in the following 
way. While the particle is diffusing it exchanges energy with the medium. It 
constantly extracts energy from the medium (Langevin term) and deposits 
it back into the medium (friction term) [2]. When it traverses a hot zone 
between xiand this results in an entropy increase 



X2 I2 




X\ Xi 



As a result, in the stationary distribution the familiar Boltzmann expo- 
nential is to be replaced with 

Two questions arise. In the first place, it may happen, for instance in a 
ring, that dV/T is not integrable. Then there exists no stationary distribution 
unless it is accompanied by a flow. That opens up the way to design a heat 
engine[2,3]. The lack of integrability is more serious in the case of more 
dimensions. It may lead to situations that are not explicitly solvable. This 
more-dimensional case has been studied in a previous paper [4] and is not 
our present concern. 

The other question is the question of the correct time-dependent form 
of the diffusion equation. For particles diffusing in a homogeneous medium 



J.A. Freund and T. Poschel (Eds.): LNP 557, pp. 69-74, 2000. 
(c) Springer- Verlag Berlin Heidelberg 2000 




70 



N. G. van Kampen 



in the presence of an external force with potential V (r) the particle density 
F(r, t) and the flow J{r,t) obey the familiar diffusion equation 

dtP=-V-J J = -/i(W)P - DVP , (2) 

where /x is the mobility and D the diffusion coefficient. One solution is known 
to be the thermal equilibrium, 

J = 0 , P — const, exp [—V {r)/kT] , 

which proves the Einstein relation 

D = kT p . 



Henceforth we set A; = 1. 

When, however, the medium and its temperature are inhomogeneous, 
both fj, and T are functions of the position r. Several ways of generalizing 
the diffusion term in in (2) are suggestive, for instance 

pTVP; VjuTP; /xVTP. 

It does not appear possible to decide between them on general grounds. It is 
therefore necessary to investigate the actual mechanism that is responsible 
for the diffusion [5] . 



2 Various Mechanisms 



Some mechanisms have been worked out in detail [6-8] . We mention three of 
them: 



a. First Landauer considered an ideal gas in a narrow pipe with constant 
diameter. There is a single variable x measuring the position along the 
pipe. The molecules collide only with the wall, which is kept at a given 
temperature T{x). His result [9,10] is 

J = -fi{VV)P - V(mTP) with IX = cT~^ . 



c is a constant proportional to the diameter of the pipe, 
b. A second mechanism is based on the diffusion of Brownian particles as 
described by the Kramers equation [11]. When we restrict ourselves to 
one dimension their distribution in phase space R{x,p,t) obeys 



dt 



■"to 



pR + T 



dp 



Where 7 is a friction coefficient. In this equation it is possible to generalize 
7 and T without ambiguity to arbitrary functions of x. Subsequently the 
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limit 7 — oo can be taken in the usual way[12]. The result is an equation 
for the density P{x, t) in coordinate space, 

J = —fj,(VV)P — ^V(TP) where ^ . 

■y[x) 

c. Finally a third mechanism has been worked out [13] consisting of a 
one-dimensional medium containing randomly located traps with density 
(j(x); each trap is a potential pit of fixed depth B. A particle at x has a 
probability per unit time a{x) to be caught in a trap, and subsequently 
an escape probability per unit time exp[— J5/r(x)j. On a coarse-grained 
scale the probability density of our particles obeys a diffusion equation 
with 

J = —fj,{\'V)P — a~^V{a^TP ) , where jj, = [c/Ta^) exp[— B/T] . 

(3) 

In a previous paper some consequences of these diffusion equations have 
been studied [4]. The present article considers another application in order 
to examine the differences between them. To facilitate the work we note that 
three equations may be combined into the form 

HV {x)P + iiTP' + sP = -J, (4) 

where sP is an additional drift term, in which respectively 

So = ifiT )' ; Sb = nT ' ; Sc = (cruT)' . (5) 

The prime indicates differentiation with respect to x. 



3 Specification of the Model 



Consider diffusion in a one-dimensional wire of length L with coordinate 
0 < X < L. The composition and the temperature are not homogeneous: 
IJ, and T depend on x and there is an external potential V{x). The density 
P{x,t) obeys (4). We ask for a steady state, in which P{x) does not depend 
on time, which implies that J must be constant. The state is maintained by 
two particle reservoirs at the ends of the wire with fixed densities Po,Pl- 
Thus we have the boundary value problem 

fiV'P -I- fiTP' + sP = — J = const, with P{0) = Po , P{L) = Pl ■ 



The solution for each of the three mechanisms is straightforward. In order 
to simplify the notation I introduce the abbreviations 



X 

W{x) = j 



^dx 

T(x) ’ 



X 

Six) = I 



s(i) 



fi{x)T{x) 



dx . 
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One then finds 



VK(i)+S(x). 



P{x) = e->^(0-s(0 |po _ j Je 

Thus the flow as a function of the densities is 

L 



dx 



n{x)T(x) 



! A 



)T(x) • 



( 6 ) 



This may be considered as an expression of the conductibility of the wire, 
but of course it is not linear in the difference Pq — Pl, nor in the length L of 
the wire. I shall denote it by p = g {L; Pq, Pl)- 



4 Applications 



We now apply the general formula for g to the three mechanisms specified in 
section 2. They differ only by the form of 5. 

a. Landauer’s pipe. 



Sa = ipT)' S{x) = logfj,{x)T{x) - logp(0)T(0) . 
Substitution in (6) gives for the conductibility 

^ _ p{L)TiL)PLe'^^^^ - p(0)T(0)Pq 
fe^i^^dx 



( 7 ) 



Moreover, in this case the mobility p has the explicit form cT = ^ so that 



- v/f(0)Fo 
J e^^^^dx 



b. Brownian particle. 



Sb = pT' S{x) = log T{x) - log T(0) . 



( 8 ) 



r(L)FLe^(^) - r(0)Po 

J e^^^^dx/ p{x) 

0 



(9) 
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c. Hopping propagation. 

Sa = -{apT)' S{x) — loga(x)p(x)T{x) - logcr(0)/x(0)T(0). 

(7 

a{L)p(L)T{L)PLe'^W - a(0)^(0)T(0)Po 

9 = 1 • ( 10 ) 

J e^(^)a(x)dx 
0 

One sees that this result coincides with (8) if one makes the special choice 
cr(ar) = 1; and with (9) for the special choice a(x) = l!p{x) - as is already 
clear from (5) . Yet this is a purely formal analogy because the mechanisms 
are quite different in all three cases. Actually in (10) the mobility has a 
special form, namely the one given in (3). 



5 Conclusions 



First, consider the steady state, by which I mean not thermal equilibrium, 
but the state in which the temperature T{x) is prescribed while the particle 
flow vanishes: J = 0. This determines the shape of the distribution and one 
retrieves the known results. 



a. 

b. 



c. 



_ const. w(x) 

^ K^)T(x) 

const. 

' T{x) 

^ const. 

* a{x)p{x)T{x) 



const. ^-w(x) 



const.<7(x)e^/^'^)e-'^(^). 



They all have the exponential factor (1). The different prefactors can be 
understood as available phase space volumes. 

As a second remark we note that the effect of the temperature on the 
conductibility can best be studied by taking F = 0. 

Then (8) reduces to 



g = {V^Pl - /L . 

The square root of the temperature represents the average speed with 
which the molecules travel in the pipe. 

The Brownian particle yields 

L 

g = {T{L)Pl - T(0)Po} / 1 dx/p{x) . 

0 
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The temperature factors represent the diffusion speed. 

The hopping mechanisms gives, when the explicit expression for p is 
inserted, 



c. 



/ e-s/r(i) _ 


. -Po -B/T(0)'l 


/ 


\a{L) 


^(0) J 


/ J 

n 



This can be more or less understood by observing that the densities Pl 
and Pq at the boundaries are reduced by the number of traps and their 
depths. 



Thirdly, let us consider a ring, so that all quantities at x = L have the 
same values as at a: = 0. Then one sees that each of the expressions (7), (9), 
(10) involves the factor 



^-W{x) _ j 



exp 



r L 

I 



Lo 



V'{^) 

T{x) 



dx 



This vanishes if on going round the ring the integral vanishes, that is, the 
expression (1) is integrable. If not, the stationary state involves a constant 
current. That is the heat engine mentioned earlier [2,3]. 

The final conclusion is rather disappointing. The three possible forms we 
have studied here for the generalized diffusion equation in an inhomogeneous 
medium lead to some differences, but these are minor and rather inconspic- 
uous. 
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Theory and Control of Multiple Hopping 
in Activated Surface Diffusion 
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Abstract. The theory of activated diffusion is reviewed. Results are presented for 
the one dimensional model of a particle moving on a periodic lattice coupled to a 
dissipative bath. Special attention is pmd to the exponential hopping limit, which 
is of interest in experimental studies of metal atom diffusion on metals. Quantum 
effects, such as the suppression of diffusion through tunneling and above barrier 
reflection are discussed. New results are presented for the quantum theory in the 
exponential hopping limit. The control of diffusion via external fields is discussed 
as well as other open questions which remain unsolved. 



1 Introduction 

The difference between activated diffusion and diffusion is that in the former, 
the diffusing object is trapped in a (potential) well and must be activated by 
its surrounding so as to escape the well. It then gets trapped in a different 
well and this process repeats itself randomly. In the latter, the diffusing ob- 
ject is constantly mobile, but moving in a random fashion due for example 
to collisions with other objects. Activated diffusion occurs in a variety of dif- 
ferent physical contexts, including surface diffusion of atoms and molecules 
[1,2], the current voltage characteristics of superconducting devices [3] or the 
rotation of molecules in solids or on surfaces [4] . Experiments on diffusion on 
metal surfaces have shown in recent years that there is a finite probability 
that a diffusing atom will hop over more than one adjacent site before being 
retrapped [1,2]. The activation energy for multiple hops has been found to 
be larger than the activation energy for single hops [2] . In this article we will 
review recent advances in the theory of activated diffusion and their appli- 
cation to interpretation of the experimental results on surface diffusion. We 
will also discuss the first (theoretical) attempts made at controlling activated 
diffusion by means of an external time varying force [5]. 

In Section II, we review the theory of classical activated diffusion, which is 
mainly due to Mel’nikov [6,7]. Special attention will be paid to the exponen- 
tial hopping limit [8] which is appropriate for most experimental observation 
of adatom diffusion on metal surfaces. The classical theory is useful for de- 
scribing the Scanning Tunneling Microscopy (STM) and other experiments 
since they have thus far been limited to heavy atoms. The theory for light 
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atom diffusion which includes tunneling and above barrier reflection has been 
worked out [9] and will also be addressed. 

In a typical experiment, whether using STM methods or field ion mi- 
croscopy, one measures the time dependent distribution of displacements of 
single atoms (or molecules) on the surface. At long times (relative to the mean 
time it takes an adsorbed atom to escape fi:om the well) the time dependent 
distribution is Gaussian and is insensitive to the nature of the hopping distri- 
bution. Only at short to intermediate times, will the effect of multiple hops 
become noticeable. The standard experimental method for obtaining the hop- 
ping distribution is to fit the experimental time dependent distribution using 
an independent parameter for each hopping probability [10-12]. In section III 
we discuss the time dependent distribution of displacements and note that in 
contrast to the experimental fitting procedure of independent hopping rates, 
modern theory predicts that all of these rates are determined by two parame- 
ters only - an escape rate and an energy loss [13, 14]. In Section IV we review 
recent results on the control of the hopping distribution [5] and we end with 
a Discussion of some of the outstanding theoretical problems that remain 
open. 



2 Classical Activated Diffusion 

2.1 The Lange vin Model 

The “standard” model used for describing activated diffusion is that of a 
particle with mass m, moving on a one dimensional periodic potential w{q), 
with “lattice length” Iq, and a barrier with height separating between 
adjacent wells. The particle is subjected to a frictional force characterized by 
a friction coefficient 7 and a Gaussian delta-correlated random force ^{t) with 
zero mean, such that at temperature T, < >= 2'ymkBT5[t-T). The 

equation of motion of the particle is the Langevin equation; 

mq + -h m-yq = ^{t). (1) 

Activated diffusion implies that the temperature T is sufficiently low so that 
>> ksT. As a result the particle spends a long time in any particular 
well between escape events, of the order of toexp{V^ /ksT) (where to is a 
time constant). The time spent by the particle outside of any given well is 
much smaller, of the order of to- 



2.2 The Strong Friction Limit 

In the limit of intermediate to strong friction, ^ > 1 (where a>o is the 
frequency of the particle at the bottom of any of the wells of the periodic 
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potential), motion is simple. The escape rate from the well F is given by 
Kramers’ expression [15] in the “spatial diffusion” limit 

— 4exp(-l/VfcBr) (2) 

7T CJ? 

where is the barrier frequency and A* is the positive solution of Kramers’ 
equation A* + 7 AI = . The particle escapes from a given well with equal 

probability to the right or to the left and immediately gets trapped in the 
adjacent well. The large magnitude of the frictional force causes a fast de- 
pletion of the energy of the particle and so after escaping from a well it gets 
immediately retrapped. The motion is thus a random walk between lattice 
sites separated by the distance Iq. The diffusion coefficient D = ^Fsdll- The 
energy distribution of the escaping particle is the thermal Boltzman distri- 
bution. The time dependent distribution of the displacements of the particle 
is a Gaussian whose variance increases linearly with time. 



2.3 The Classical Hopping Probability Distribution 

The dynamics of the diffusing particle becomes more interesting as the mag- 
nitude of the friction coefficient is decreased. The important parameter now 
becomes the (reduced) energy loss <S, which is the average energy (in units of 
ksT) lost by the particle as it moves from one barrier to the adjacent one. 
The magnitude of the energy loss is well approximated by the product of the 
friction coefficient and the action of the particle as it moves from one barrier 
to the next at the energy V^: 

/ OO 

dtq^{t). (3) 

*00 

For example, for the periodic cosine potential 

w{q) = cos^ 

the energy loss is readily found to be 5 = For atom diffusion on 

metal surfaces, although the friction coefficient is typically expected to be 
small [13], the barrier height is usually large when compared with ksT and 
the energy loss parameter is usually of the order of unity or larger. In this 
limit, the energy distribution of the escaping particle is thermal and the 
escape rate is given by Eq. 2. 

If the energy loss is not too large 5 < 10 the particle has a measur- 
able probability of jumping over a few adjacent wells and only then getting 
retrapped. The hopping probability pj is defined as the probability that a 
particle is initiated at the zero-th well, escapes, and is then retrapped for the 
first time in the j-th well which is a distance jlo from the original well. As 
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shown in Refs. [7,9], the (classical) hopping probability depends only on the 
reduced energy loss parameter 5 and is given by the expression: 



Pi = - 



El 

To 



- j dksiv? cos{jk) exp[/(fc)j ~ 



£l, 

^sd 



where 



and 



f{k) 






~P{rf 



2F(r) cos(A;) 



( 5 ) 

(6) 



P(r) = exp 




( 7 ) 



In Eq. 5, Fj, j 0 is the rate of particles entering the j-th well, while Fq 
is the (negative) rate of particles exiting from the 0-th well. For large 6 the 
difference between —Fq and Fgd is negligible. 

When more then single jumps are allowed, the diffusion coefficient in- 
creases and is given by the expression D = \F < F > where the mean 
squared hopping distance < F >= E^oPn(n/o)^- As the energy loss tends 
from above towards d ~ 1, the escape rate increases and the hopping dis- 
tribution becomes broader. Both effects cause an increase in the diffusion 
coefficient. The hopping distribution should be distinguished from the dis- 
tribution of jump lengths, which is the probability that the particle jumps a 
distance nlo before first being reflected by a barrier. 



The classical exponential hopping limit. The exponential hopping limit 
is obtained when the energy loss is sufficiently large, such that exp{-6/4) « 
1. In this limit, one can show [5,8] that Eqs. 5,6 reduce to the result: 

,—3/2 

P/+1 = P-(j+i) - j>l. (8) 

This result has a simple physical interpretation. When the energy loss is large, 
the distribution of escaping particles is thermal [6, 7]. Therefore the fraction 
of particles that start at a barrier top and make it to the adjacent barrier 
top is given by (the barrier energy is 0): 



where 



roo poo / 

^ 2,1 ~ y de j de'F {e\e')exp{—e') = erfc f 



2 



\/^ 



exp(-J/4) , d » 1. 






e -f <S)^ 



46 



( 9 ) 



(10) 
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is the probability that the particle starts at the first barrier top with (re- 
duced) energy e and makes it to the adjacent barrier top with energy e'. The 
generalization to longer hops is evident. 

Obviously, in the exponential hopping limit, the activation energy for a 
hop length of {j + l)/o is larger by ksTS/A than the activation energy for a 
hop whose length is j7q. This result is in good agreement with experimental 
observation for the diffusion of Pt on the Pt(110)-(lx2) missing row recon- 
structed surface [2]. For this system, the reduced energy loss varies from 5.8 
to 7.4 over the temperature range studied experimentally (300-380 K). The 
absolute magnitude of the energy loss is estimated to be 0.19eV leading to an 
added activation energy of ~ .05 eV for double jumps as compared to single 
jumps. A somewhat different interpretation of the added activation energy 
has been suggested in Ref. [16]. 



The underdamped limit. In the underdamped limit, the energy loss pa- 
rameter becomes small << 1. The exchange of energy between the particle 
and its surroundings becomes slow and the escape rate becomes proportional 
to 5. In this limit, the energy distribution of the escaping particles becomes 
non thermal, the average (reduced) energy of the escaping particles ~ \/6 
[ 6 , 7]. On the other hand, the particle loses only the energy 6 when traversing 
from one barrier to the next. Therefore, on the average, the mean jump length 
will be ~ lo/VS. After 1/S such jumps, the particle will lose on average suffi- 
cient energy (A:bT) to become retrapped. The mean squared hopping length 
is therefore < >~ 1/6^. Although the escape rate decreases, the mean 

squared hopping length increases more rapidly and the diffusion coefficient 
diverges as 1/S. The hopping distribution is no longer exponential but has a 
power law dependence. 



2.4 Beyond Langevin Dynamics 

The generalized Langevin model. A further generalization of the acti- 
vated diffusion problem is obtained by introducing a memory friction and 
describing the motion of the particle in terms of the generalized Langevin 
equation: 



mq + J ~ ~ 

where the random force ^(f) is Gaussian with zero mean but the fluctuation 
dissipation relation takes the form < C(f)^(r) >= mkBT'y{t—T). The memory 
friction 7 (f) is usually characterized by a friction strength 7 = dt'y{t) and 
a characteristic memory time r. Typically, memory weakens the effect of the 
damping. For a given value of the friction strength 7 , the energy loss will 
become larger as the memory time becomes shorter. As long as the memory 
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time is not much longer than the typical period of the particle in the well, 
the energy loss parameter 6 is readily given as: 

^ / dt f dt'q{t)j{t - t')q{t') (12) 

where q{t) is the trajectory of the unperturbed particle as it traverses from 
one barrier to the next on the potential w{q), at the barrier energy. 



Quantum effects. Generalization of Mel’nikov’s theory to include the ef- 
fects of memory and quantum tunneling and above barrier reflection ef- 
fects was presented in Refs. [9, 17]. In the quantum regime one introduces 
a crossover temperature To such that above this temperature, the escape of 
the particle is dominated by crossing over the barrier while below this tem- 
perature escape is dominated by below barrier tunneling. Above the crossover 
temperature, tunneling causes an increase of the escape rate. However tun- 
neling and above barrier reflection also affect the jump and hopping distri- 
butions. For sufficiently low friction, tunneling and above barrier reflection 
tend to significantly shorten the jump length distribution and as a result the 
mean squared hopping length is decreased. The net result, is that for low 
friction, the quantum diffusion coefficient is less than the classical diffusion 
coefficient. This predicted quantum suppression of diffusion has not yet been 
measured experimentally. 

Just as in the classical limit one may readily obtain relatively simple ex- 
pressions for the hopping distribution in the exponential hopping limit, where 
g-i/4 <;<; X is the small parameter. In this limit, the energy distribution of 
the escaping particles remains the thermal distribution. The flux of particles 
F\ that are initiated in the zero-th well and make it to the adjacent one is 
therefore well approximated as: 







(13) 



where T(e) is the quantum transmission probability through the barrier at 
the (reduced) energy e. Above the crossover temperature, T(e) may be ap- 
proximated by the parabolic barrier limit T(e) = e“^/(l -f e“^), where the 
quantum parameter a = ^ At the crossover temperature a = 1. In the 
parabolic barrier limit, one readily finds that Fi = ■ 

The flux of particles that are initiated in the zeroth well and make it to 
the well which is a distance of 21q away is approximated as: 

/ OO rOO 

de / de'Tie)P{e\e')T{e')e-d (14) 

-OO J — OO 



where the conditional probability P{e\e') is the same as defined above in Eq. 
10. Using the parabolic barrier transmission coefficient, one finds after some 
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rather tedious algebra that: 

OO 

na + 1/2)) 

.n=0 



- ^ (v^( na + a — 1/2)) 

n=0 




The quantum probability for hops whose length is at least 21q is thus equiv- 
alent to the product of the classical multiple jump probability (see eq. 9 and 
the quantum factor ^ cot(^). This quantum factor is little or equal unity, 
thus showing explicitly that quantum tunneling and above barrier reflection 
lead to a reduction of the multiple hopping probability. 



F2 = 



Multidimensional effects. In practice, diffusion usually occurs in more 
than one dimension, for example in surface diffusion, the diffusing particle is 
moving in three dimensions. A generalization of the theory of activated dif- 
fusion to include multidimensional effects is an active area of research [8, 18- 
20]. Qualitatively, the added dimensionality leads to increased energy losses 
as the particle moves from one barrier to the next one. Added dimensionality 
therefore also typically leads to a shortening of the jump and hopping length 
distributions. 

3 The Time Dependent Hopping Distribution 

As mentioned in the Introduction, in a typical experiment [1,2,21], one mea- 
sures the time dependence of the spatial probability distribution of the ini- 
tially localized particle. At long times the evolution is universal, controlled by 
the diffusion equation and the shape of the distribution is Gaussian. At the 
early stage however, the shape of the distribution is sensitive to the hopping 
distribution. In this section we will derive explicit expressions for the time 
dependent distribution, where the input is the hopping distribution as given 
in Eqs. 5-7 

The location of the particle on the lattice is denoted by the two indices 
l,m such that the location of the particle at time t=0 is at f = m = 0. The 
probability distribution for tbe particle to be at the l,m site at time 

t is determined by the following master equations: 

^ C50 OO 

j=—oo j= — 00 

Here we assume that the particle can jump independently along two lattice 
directions with the transition rates Fj and = 0, ±1, . . It is understood 
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that the rates rj} and Fq are negative, allowing for escape from the l,m site. 
The escape rate F from the site is thus F = — (Tq +Tq ). The initial condition 
for the distribution is: 



— 0 ) — ^ 1,0 ' ^m ,0 



(17) 



The master equation may be solved by Fourier transforms due to the 
translational invariance of the surface. One finds that 



where 



and 



rD(k,f) = 



ikl 



Prom Eq. 18 it follows that 



m,rn(t) = wl(t)w^(t), 



where 









Using the known expression for the rates /] one finds that 

In 



F(k) = 2sin^ ( ^ ) Tsdexp 



i 

7T Jo 



l+exp(-i5(8^ + ^)) 
l-exp(-i5(s2+i)) 






(18) 

(19) 

( 20 ) 

( 21 ) 

( 22 ) 



(23) 



Eqs. 21, 22, and 23 give the explicit solution for the time evolution of the 
probability distribution wi^rn- 

It cannot be overstressed that the time dependent distribution is a func- 
tion of only two parameters, the energy loss <5 and the rate Fgd- In contrast to 
the procedures used by the experimentalists [10-12], where they assume that 
each Fj is an independent parameter, one should fit the complete time depen- 
dent distribution using only S and Fgd as the two experimental parameters. 
We have shown that all measured time dependent distributions are described 
accurately using this two parameter theory [8, 13, 14]. 



4 Controlling Activated Diffusion with External Fields 

The physics of the activated diffusion problem become even more interesting 
when introducing an external field. A constant field will introduce an asym- 
metry in the periodic potential, the barrier height for motion to the left will 
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be higher than the barrier for motion to the right. The (reduced, in units of 
ksT) energy difference between adjacent barriers u will be assumed through- 
out this paper to be smaller than the reduced barrier height = V^/ksT. 
In this sense, we will deal only with “weak” fields. A noticeable change in the 
diffusion dynamics is obtained only if u is of the order of unity or greater. 
In other words, the absolute magnitude of the fields involved is actually not 
small. 

The diffusion dynamics of the Langevin equation in the presence of a 
constant field has been solved by Mel’nikov [7]. The constant field changes the 
barrier height for motion to the left or to the right and also affects the energy 
loss of the particle. The hopping distribution in the presence of a constant 
field was studied in Ref. [5] in the exponential hopping limit. Because of 
the applied force, the probability for larger jump lengths increases and the 
diffusion coefficient is increased. 

The theory for the diffusion dynamics in the presence of an ac field is 
at its infancy. Some preliminary results have been obtained in the limit of a 
slowly varying field, using adiabatic approximations. These results indicate 
that also an ac field will increase the escape rate and the jump length and thus 
the diffusion coefficient. In the strong damping limit, stochastic resonance is 
not observed on the level of the diffusion coefficient, it does affect though 
the jump dynamics [22]. Whether stochastic resonance may be observed at 
weaker damping through the effect of the field on the jump and hopping 
distributions remains an open question. 

5 Discussion 

The theory of activated diffusion is far from being complete. Open questions 
remain with regard to the multidimensional theory, such as the magnitude 
of the energy loss and its dependence on temperature. In the underdamped 
limit, for a system with n dimensions, one expects the energy loss to be 
proportional to (/3T^)", but in the exponential hopping limit, the dependence 
is linear on The crossover from the underdamped limit to the exponential 
hopping limit has not been worked out. 

The quantum theory is also far from completion. Thus far, only the one di- 
mensional incoherent hopping theory has been worked out. What happens in 
the presence of more than one dimension? How does the quantized structure 
of the added degrees of freedom affect the hopping dynamics? What happens 
at very low temperatures where the hopping can no longer be considered as 
an incoherent process? 

One can contemplate additional features to be added to the theory. For 
example, what is the hopping dynamics for a multiple periodic or quasiperi- 
odic or random chain. One can change barrier heights, lattice distances and 
other parameters and study the effects of each one on the hopping dynamics. 
Can such effects be seen when measuring the time dependent distribution? 
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As already mentioned controlling the hopping distribution is a topic at 
its infancy. Very little theory and no experiment exist as of the writing of 
this paper. Whatever theory does exist, does not take quantum effects into 
consideration. Numerically exact computations are not easy even in the clas- 
sical limit, while in the quantum case, they remain prohibitive. Given all 
these questions it would seem, that the theory of activated diffusion will be 
a source of delightful new physics for years to come! 
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Abstract. General expressions for the diffusion tensor in a d-dimensional medium 
with a fluctuating friction tensor are presented. In two dimensions an explicit ex- 
pression of the diffusion tensor is found for a dichotomic Markovian friction process. 
Even if the friction is isotropic on average, the diffusion tensor in general happens 
to be anisotropic. 



1 Introduction 

Diffusion and Brownian motion have been at the heart of nonequilibriura 
statistical mechanics since the beginning of the 20th century when Einstein, 
Smoluchowski and Langevin founded the theory [1], Since then this theory 
flourishes and has found countless applications not only in the original field 
of statistical physics but also in almost all branches of natural and technical 
sciences, and, from the very beginning, but almost completely unnoticed, also 
in the theory of finance [2] . 

In the archetypical case of Brownian motion, a particle of mass m sus- 
pended in a fluid experiences two types of forces both originating from the 
surrounding fluid: a frictional force Ff that dissipates the kinetic energy of 
the particle and a random force Fr{t) that pushes the particle in an erratic 
way. For small velocities v of the particle relative to the fluid, the friction 
force is linear in v, Ff = —jv. The random force Fr{t) has zero mean and is 
uncorrelated at different times. Its statistics is Gaussian and its strength is 
related to the temperature T of the fluid and the friction constant 7 by the 
Einstein relation [3]: 

{Frit)) = 0, {Fr{t)Fr{s)) = 2jkBTS(t - s) (1) 

where ks is the Boltzmann constant. 

This simple model has been extended, modified and generalized in many 
different ways. For example, one may allow for a potential forces that act 
on the considered particle in an external field of force [4]. Other generaliza- 
tions concern the random and the frictional forces. For example, the sur- 
rounding medium may undergo slow processes that result in longlived cor- 
relations of the fluctuating force and, at the same time, in memory friction 

= fo - s)x{s). For a surrounding medium in thermal equilibrium at 
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temperature T the two forces are related by a fluctuation dissipation theorem 
{Fr{t)Fr{s)) = kBT-f{t — s) [5]. In contrast, an environment consisting of two 
separate parts (heat baths) at different temperatures presents an example of 
a nonequilibrium situation in which one expects a heat flux from the hot to 
the cold heat bath through the system. In an extreme case one bath is at 
infinite temperature and couples weakly to the system such that it acts on 
the particle only by a random force, while the other bath is at zero temper- 
atures. It causes the friction which now is independent of the random force. 
Colored noise is a particular example of this very situation [6]. 

In the strongly overdamped limit the trajectories of the Brownian particle 
become realizations of the Wiener process which has nice self-affine properties 
under the rescaling of time and amplitude. The respective scaling exponent 
is 0.5. The Wiener process belongs to the fractional Brownian motion family 
whose members are characterized by their scaling exponent or Hurst index H 
[7]. This index has been used to characterize various noise phenomena ranging 
from electrical resistance noise to fluctuations of financial indices and those 
of high water levels of big rivers like the Nile [8]. Not so much seems to be 
known about the Spree and the Havel rivers in this respect. 

Other generalizations concern the statistical character of the noise which 
may be non-Gaussian. If the noise is still white the resulting velocity of the 
Brownian particle will typically show jumps [9]. Levy flights are particular 
examples [10]. 

A fascinating generalization of Brownian motion in yet another direction 
has recently been suggested by our Geburtstagskind Lutz, who introduced 
interactions in a swarm of Brownian particles. This leads to so-called active 
Brownian particles which show interesting cooperative effects like pattern 
formation in the one particle density [11]. 

In this article we pursue the recent idea that the friction coefficient may 
be a fluctuating quantity that randomly changes its value in space and time 
[12, 13]. One expects this to happen in a fluid near the critical point or in a 
mixture of fluids, near the critical point of demixing. 

Particles diffusing in a ferroelectric fluid in presence of an external mag- 
netic field will also experience a fluctuating friction coefficient. The cases 
studied so far in refs. [12, 13] were restricted to one dimensional motion with 
spatially constant friction. Here we will study diffusion in a d-dimensional 
fluctuating medium. The fluctuations are still supposed not to vary in space. 
However, the realizations of the friction coefficients need not be isotropic. 

The idea of a fluctuating transport coefficient like the friction coefficient 
is not so outlandish as one might think at first sight. For example, light 
scattering in a continuous medium is attributed to fluctuations of the dielec- 
tric constant which also is a transport coefficient. Fluctuations of the Ohmic 
resistance of an electrical conductor provides another example. 

In the next Section we formulate our model and derive a first expression of 
the diffusion tensor in terms of the averaged time-ordered exponential integral 
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of the fluctuating friction tensor. In Section 3 this average is shown to be 
determined by the curtailed characteristic functional of the stochastic process 
of friction coefficients. If this friction process is Markovian, the equation of 
motion of the curtailed characteristic functional has the form of a forward 
master equation containing a sink term. The formal solution of this equation 
can be used to derive an alternative expression of the diffusion tensor which 
no longer contains time ordered exponential integrals. In Section 4 we restrict 
ourselves to two dimensions and consider Markovian dichotomic fluctuations 
of the friction coefficients. It turns out that the diffusion tensor is in general 
anisotropic even if the average friction tensor is isotropic. 



2 Formulation of the Problem 

We consider the d-dimensional Brownian motion of a massive particle in an 
external potential U (x) under the influence of a spatially constant and in time 
fluctuating friction tensor 7 (f). The motion of the particle with coordinate 
X = (xi,X 2 ,...Xd) and velocity v = (vi,V 2 , —Vd) is governed by the Langevin 
equations: 



x(t) = v(t), 

mv(t) = -VC/(x) - 7 (<)v(t) + ^y2kBTh{t)i{t), (2) 

where VC7(x) is the gradient of the potential and b(t) is related to the (non- 
negative) friction tensor 7 (f) as follows 

7 (t) = b(<)b(t)^, (3) 

where f{t) = ...fd{t)) is a vector of independent, identical Gaus- 

sian white noise sources and denotes the transpose of the d x d matrix 
M: 

(/«(*)) = 0, - s). (4) 

Note that, given the process 7 (f), b(t) is not uniquely defined because for 
any unitary matrix U(t), the matrices b(t) and b(t)U(t) yield the same re- 
sult for 7 (f). It, however, will turn out that this ambiguity has no influence 
on the final result. The processes 7 (t) and f(t) are supposed to be mutually 
independent. The particular relation between the friction and the random 
forces simplifies in one dimension to the Einstein relation (1). It guaran- 
tees that the probability density of the Brownian particle approaches the 
Maxwell-Boltzmann distribution Z~^exp{- (mv^ -t- C/(x)) /(ksT)} in the 
limit t ^ 00 , provided the potential f/(x) is confining such that the partition 
function Z = f f d‘‘xd‘‘v exp {- (mv^ -\-U{x)) f{kBT)} is finite. As for the 
one dimensional case, one can show that detailed balance is fulfilled for the 
combined process of the friction coefficients and the Brownian particle if the 
friction coefficients transform evenly under time reversal [ 12 ]. 
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In the following we will disregard the presence of an external potential 
which we have introduced in order to elucidate the equilibrium properties of 
the Langevin equations (2). The general solution of the Langevin equation (2) 
with f/(x) = 0 can be defined in terms of the propagator G(t,s) satisfying: 

d X 

_G(t,s) = -- 7 (t)G(t,s), G(s,s) = l, (5) 

where 1 is the d-dimensional unit tensor. The formal solution of (5) is given 
by the time-ordered exponential of the friction tensor 'y{t ) : 



G(t, s) =T exp 




( 6 ) 



Here T denotes the time ordering operator [16] which arranges the product 
of two time dependent tensors A(t) and B(s) according to the order of t and 
s: 



’ ^ ’ ~ \B{s)A{t) for t<s. 



(7) 



For later use we note the backward equation which is also satisfied by G(t, s): 

( 8 ) 



s) = —G{t, s) 7 (s), G(t, t) = 1. 



In terms of the so defined propagator G(t,s) the velocity becomes: 






y{t) = G(t,0)v(0) + 

m 

and accordingly the position: 

x(f) = x(0) -h [ dsG{s, 

Jo 



f 



dsG{t,s)h{s){{s) 



(9) 



,0)v(0) + 



VW 



[ ds r ds'G{s,s')h{s'){{s'). 
Jo Jo 



( 10 ) 

Taking the average of the fth component of the position multiplied by the 
jth component of the velocity one finds for the corresponding element of the 
position-velocity correlation function: 



(xi{t)vj{t)) = {xi{0)Gj,k{t,0)vk{t)) + f ds{Gi,k{s,0)vk{0)Gj,iit,0)vi{0)) 

Jo 

knT /** 

^0 ^0 ^0 



where here and in the sequel summation over double indices is always under- 
stood. Because the friction tensor is positive definite, the propagator G{t, s) 
decays with increasing time t for fixed values of s. Therefore the first two 
terms on the right hand side of (11) can be neglected for sufficiently large 
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times t. The average over the fluctuating force f(t) can be performed in the 
remaining term to yield: 

(xj(t)nj(t)) = 2^^ f ds f ds'{Gi^kis,s')bk,i{s')Gj^p{t,s')bpj{s')) 

'm- Jo Jo 

= 2^ r ds r ds'{Gi,k(s, s')Gi,p{t, s')^k,pW)-) (12) 

Jo Jo 

Using the symmetry of the friction tensor and the backward 

equation (8) we find; 

{Xi(t)vj{t)) = ^ fds [\s'^{Gi,k{s,s')Gj,k{t,^')) 

^ Jo Jo 

^ M: f ds{{Gj4t,s)) - {Gi,k{s,0)Gj,kitM}- (13) 
m Jo 

For large t-values the second contribution can be neglected and we obtain for 
the position velocity correlation in the limit of large times t: 

{Xi{t)vj{t)) = ^ f ds{Gj,i{t,s)). (14) 

m Jo 

For the moment being let us assume that the longtime behavior of the Brow- 
nian particle is diffusive, i.e. that the position correlation grows with t: 

{xi{t)xj{t)) - 2Dijt (15) 

where Dij denotes the i,jth element of the diffusion tensor D. It can be 
expressed in terms of the symmetric part of the position velocity correlation 
function: 

Di,j = -x lim [{xi{t)vj(t)) + {vi{t)xj{t))] . (16) 

z t— >oo 

Using eq. (14) we obtain: 

D= — lim [' ds{(G{t,s) + G{t,sf)). (17) 

2m Jq 

This is our first main result of the present note. We note that in all cases 
in which D has a finite, nonzero value the longtime limit of the Brownian 
particle is diffusive, i.e. the position correlation function grows proportional 
to t. 

3 Diffusion Tensor 

and Curtailed Characteristic Functional 

The explicit calculation of a time ordered integral like the one entering the ex- 
pression for the diffusion tensor, see eqs. (6) and (17), presents a notoriously 
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difficult task. We therefore bypass this problem and introduce an auxiliary 
function which is known in the literature as the curtailed characteristic func- 
tional [14, 15] 

V(7,f,s) = (rf( 7 (f) - 7 )G(f,s)), (18) 

where the average is taken over stationary realizations of 7 (t) . Here S{‘y{t) — 7 ) 
denotes a Dirac S function in case of a firiction process that takes values 
from a continuous state space, and a Kronnecker J for a discrete state space 
of friction. For a Markovian friction process 7 (f) the time evolution of the 
curtailed characteristic functional can be expressed in terms of the master 
operator A that governs the forward equation of the probability ^( 7 , t) of the 
process 7 (f) as it evolves from an initial probability: 

— p(7,0 =^p(7,0- (19) 

For the sake of simplicity, we will not distinguish in notation between friction 
processes with discrete and continuous values and always refer to p( 7 , t) as 
a probability also if it actually is a probability density. Note, that in either 
case it is given as the average of S(‘y{t) — 7 ) with the 5 function specified as 
above. 

In particular for the stationary ensemble over which the average is taken 
in eq, (18), one obtains the stationary probability: 

- 7)) = Pstii), (20) 

which satisfies the equation: 

^Psth) = 0. (21) 

The curtailed characteristic functional can be considered as a hybrid of 
the probability of j{t) and the generating function of time ordered moments 
of the integrated friction process ds''f{s'). It satisfies the following equation 

of motion: 

^ 1 

^ V ( 7 , t, s) = AY ( 7 , t, s) - — 7 V ( 7 , t, s) (22) 

together with the initial condition (cf. eq. (18)) 

V( 7 ,s,s) = (<J(7(s) - 7 ))i =p(^,s)l =pst( 7 )l. (23) 

The equation of motion (22) follows from the definition (18) by differentiation 

with respect to t. The first term on the right hand side of eq. (22) results 

from the derivative of the S function and the second term from that of the 
propagator, see eq. (5). The initial condition (23) follows from the respective 
condition on G(t, s), eq. (5), and the fact that the average is taken over sta- 
tionary realizations of 7 (f) which occur with the probability ^* 4 ( 7 ). Because 
( 22 ) is a homogeneous differential equation with respect to t and because the 
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initial condition (23) does not depend on the initial time s, the characteristic 
functional depends only on the time difference t — s: 



V{'y,t,s)=V{'y,t-s,0). (24) 

We denote its Laplace transform by V( 7 ,z): 

/•OO 

Vh,z)= dte-^‘V(7,t,0). (25) 

Jo 

The diffusion constant (17) can be expressed in terms of the Laplace trans- 
form of the curtailed characteristic functional (18): 

D = ^ d7 (V(7, 0) + V(7, 0)^) . (26) 

The integral dy stands for the sum over all realizations of 7 (f) in the case 
of a discrete state space or for the integral if 17 is a continuous state space. 
The representation (26) of the diffusion tensor D in terms of the curtailed 
characteristic functional is the second main result of this note. 

The equation of motion of the curtailed characteristic functional yields 
for its Laplace transform: 

r . 1 ' 

z - A + —7 
m 

which can formally be solved: 



-1 

Psthn- ( 28 ) 

By means of the curtailed characteristic functional the determination of the 
diffusion tensor is reduced to the solution of an inhomogeneous linear equation 
and to a final integration over all realizations of the friction tensor. 

4 n-state and Dichotomic Friction in a Plane 

As an example we study diffusion in d = 2 dimensions with a friction ten- 
sor that may take n realizations of symmetric, positive 2 x 2 , matrices 7 j, 
i=l,2,...n, according to a Markovian process. That means, that the probabil- 
ities pi{t) = prob( 7 (t) = 7 ,) satisfy a master equation: 



V(7,^) = 



z — A^ 7 

m 



V(7,^)=P.t(7)l- (27) 



j^i j^i 

where qij denotes the transition rate from state j to L Collecting the prob- 
abilities of the different states into a vector p{t) = {pi{t),p2{t), ...,pn{t)) we 
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can write the master equation (29) in the form of eq. (19) where A takes the 
form of the following matrix: 



92,1 Qn-1,1 9n,l \ 

92,1 - 9j,2 • ■ • 9n-l,2 9n,2 

^ = (30) 



I 9n — 1,1 9n— 1,2 ■■■ 1 9j,n— 1 9n— l,n I 

V 9n,l 9ra,2 ■ ■ ■ 9n,n— 1 ~ ^2j:^n 9j,n / 

For z = 0 eq. (27) assumes the form: 

-E«mV( 7^.0)+ + I V(7,,0)=pf (31) 

Wi J 

where pf denotes the ith component of the stationary probability pst satis- 
fying: 

Apst = 0. (32) 

Recall that 7j and V(7j, 0), i = 1, ...n are 2 x 2 matrices. 

We now make the further simplifying assumption that there are only two 
possible friction matrices 




where ai, Cj > 0 and aiCi > bf, i = 1, 2, in order that the friction matrices are 
non-negative. For A we write: 



yl = 



-t' p 

and obtain for the stationary probabilities solving (32) : 

P .t V 



Pf 



p + 



P2‘ 



p + v 



(34) 



(35) 



This particular friction process is a Markovian dichotomic process, i.e. 7(t) 
stays in either of the two states 7^ or 72 with exponentially distributed 
waiting times which on average are l/i/ and l/p, respectively. The equations 
(18) for the components of the Laplace transformed curtailed characteristic 
functional become: 



-mV (72,0) + {u+ — 7i)V(7i,0) = —^1, 
m p + u 

-i^V(7i,0) -I- (m+ — 72)V(72,0) = ^—1. (36) 

m p + V 

Introducing appropriate dimensionless quantities: 

= V. = .'V(T..,0), V, = „V(7„0), r=r 

(37) 
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we obtain 

-V2 + (1 + 7i)Vi = 

-Vi + (1 + 72)V2 = (38) 

These equations are readily solved for Vi and V2: 

Vi = [7i + 72 + 727 i]“^ (^1 + > 

V 2 = [7i + 72 + 7 i72]“^ (^1 + 

In case of a dichotomic process of the friction tensor, the integral in eq. (26) 
has the meaning of a sum over the two states and one obtains for the diffusion 
tensor: 

D = 0)^+V(72,0)®) 

= ^(Vf+rVf)), (40) 

mi/ 

where M‘^ = (M + M^)/2 denotes the symmetric part of a real matrix M. 



4.1 Isotropic Average Friction 

As a further simplification we assume that the average friction is isotropic, 
i.e. that it is proportional to the unit tensor: 

Pf 7 i +Pf 72 = 7 ol, (41) 

Its average value is given by the scalar friction coefficient 70- Using eq. (35) 
and the dimensionless quantities defined in (37) we obtain: 

7 i+ 72 = 7 o 1 , ( 42 ) 

where 70 = denotes the dimensionless average scalar friction. As a 

consequence of eq. (42), the two matrices 71 and 72 commute with each 
other and, using (40) one obtains for D: 



7 rr\ 

D = [(/Li + ii)m 7 ol + 7 i 72 ]~^ [(/* + + 70 ( 7 i + 72 - 7 ol)] • 

7 o 

(43) 

It can be rewritten in the form 



D = 



keT 



{1 + [in + i/)m 7 ol + 7 i 72 ] ((7 - ( 7 )) )}, 



70 



(44) 
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where the variance of 7 (f) becomes in the stationary ensemble: 



((7 - ( 7 ))^) == 7o(7i + 72 - 7ol) - 7 i72- (45) 

Although we have started from a friction tensor which is isotropic on average, 
the resulting diffusion tensor in general is anisotropic. In two dimensions the 
anisotropy of D can be characterized by the ratio of the difference of its 
eigenvalues Ai and A 2 and their arithmetic average: 






q Ai - A2 

Ai + A2 



(46) 



The absolute value of A is at most 2 and D is isotropic only if A = 0. Fig. 1 
shows the anisotropy measure A as a function of the eigenvalues x and y of 
the tensor 7 ^ . Note that 7 ^ and 72 are diagonal in the same basis and that 
with eq. (42) the eigenvalues of % are 70 -x and 70 - y. The diffusion matrix 
is isotropic where A vanishes. This happens on two intersecting curves in the 
plane spanned by x and y. One of these curves corresponds to the trivial case 
X = y in which each of the two realizations is isotropic. On the other branch 
the anisotropic friction matrices properly combine to an isotropic diffusion 
tensor for a given ratio r of waiting times. In Fig. 1 the anisotropy measure 
is only shown for r < 1 . For larger r- values one may use the symmetry of A 
under the joint exchange of 7 ^ ■<-> 73 and r -t 1 /r. 



5 Summary 

We extended the problem of Brownian motion in a medium with a fluctuat- 
ing friction coefficient from one spatial dimension to an arbitrary number of 
dimensions. For this problem we found a formal expression for the diffusion 
tensor in terms of a time ordered exponential integral of the friction tensor 
which in one spatial dimension simplifies to the known expression [12]. It is 
an interesting open question whether the inequalities that are known to hold 
between the effective diffusion and certain limiting cases have a counterpart 
also in the d-dimensional case and if so, how these inequalities look like. For 
a Markovian friction process we further expressed the diffusion matrix in 
terms of the curtailed characteristic functional and in this way avoided the 
calculation of the time ordered exponential integral. 

Another interesting, more realistic, and more complicated problem arises 
if the friction also exhibits spatial fluctuations. These might introduce subtle 
correlations in the dynamics of the Brownian particle. So, as usual we close 
with more open questions and new problems than we began with. 
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Fig. 1. The anisotropy measure .A as a function of the eigenvalues x and y of the 
friction tensor ■7^. In panels (a), (b) and (c) the value of the dimensionless average 
scalar friction is 70 = 0.1 and the ratios of the waiting times axe r = 1, r = 0.1, and 
r = 0.01, respectively. In panels (d) and (e) A is shown for r = 1 , 70 = 0.1 and 
7o = 10, respectively. The dependence on r is qualitatively the same for these 70- 
values: with decreasing r the saddle point of A where the trivial and the nontrivial 
anisotropy branches cross moves towards larger x values. In this way the nontrivial 
isotropy branch becomes shorter with decreasing r and seemingly disappears. 
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Abstract. We investigate the dynamics of Brownian particles which are active in 
the sense that they take up energy from the environment, which can be stored in a 
internal energy depot and used for different activities. As one example, we consider 
the generation of a self-consistent field, which in turn affects the movement of 
the particles. The dynamics can in this case be described by coupled reaction- 
diffusion equations, but will be more efficiently simulated by means of Langevin 
equations for the active particles. As another example, we discuss the active motion 
of Brownian particles which can be described by a non-linear, velocity-dependent 
friction function. Provided a supercritical supply of energy, the active particles are 
able to perform non-trivial motion, such as “uphill” motion against the direction 
of an external force, or motion on a stochastic limit cycle. 

1 Simulation of Reaction-Diffusion Systems 

Reaction-diffusion systems are known to exhibit a large variety of fascinating 
patterns. Among the prominent examples are spiral patterns in the Belousov- 
Zhabotinsky reaction, or patterns on sea shells or mammalian coats. Despite 
their very different appearence, the basic dynamics of these patterns can in 
many cases be described by a set of coupled reaction-diffusion equations. For 
the case of two distributed components Cm and Cn with the spatio-temporal 
densities m{r,t) and m{r,t), they are in general of the form: 

= ^{m, n) + DmAmir, t) (1) 

'^) + DnAn{r, t) (2) 

Here, the last term of both equations describes the spatial diffusion of the 
different components, while the functions !F{m,n) and Q{m,n) describe the 
interaction between the two components. Let us, as one example, assume that 
the first component, Cm, will be produced by the second one at a spatially 
constant rate s and that its concentration further decays at a contant rate, 
km- Then, the reaction function !F{m,n) reads: 

J^{m,n) = sn{r,t) — kmni{r,t) (3) 

The particles of the second component, Cn, on the other hand, should exist 
at a constant number N, i.e. 

N = j n{r,t) dr = const. (4) 

Ja 
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and will be only affected by the gradient of the density m{r,t) in the following 
manner: 



g{m,n) = - 



dr 



dm{r,t) 
" Wr 



n{r,t) 



(5) 



With eq. (5), eq. (2) for the second component becomes in fact a Fokker- 
Planck equation, where Q{m,n) denotes the drift term. If m{r,t) in eq. (5) 
would be replaeed by a time-independent function U{r), for instance, this 
term would describe the motion of the Cn particles in the external potential 
U{r). But in this case, the “potential” is also created by the Cn particles 
according to eq. (3) and is therefore denoted as a self-consistent field. Here, 
Q denotes the “strength” of the response to the gradient of the field. 

The non-linear feedback between the particles with density n{r,t) and 
the self-consistent field m{r,t), may result in a spatial structure formation, 
that has been investigated by Schimansky-Geier et al. in different variants 
[16, 17]. A particular application of this model may describe the aggregation 
of larvae and other biological species (denoted by G„) which communicate 
via a chemical field (denoted by m(r,t)), using chemotactic response [21]. 

A conventional way to investigate this spatio-temporal process would be 
the integration of the two coupled differential eqs. (1), (2), with respect to 
eqs. (3), (5). The time step required for the integration, is mainly determined 
by the nonlinearities of the equations. Suppose that n(r,t) and m{r,t) are 
of the same order, then the allowed time step At should be less than: 



dn{r,t) dm{r,t) 
dr dr 



-1 






( 6 ) 



i.e. it should decrease according to the square of Vm. In the presence of 
strong gradients, this could be sometimes rather decelerating. Therefore, it 
would be convenient to find a more efficient simulation method. 

An alternative, particle-based approach, w'hich may result in a much faster 
computer simulation, is based on the correspondence between the Fokker- 
Planck equation, (2), (5), and the overdcimped Langevin equation, 

+ y/^Ut) (7) 

The second term of eq. (7) results from a stochastic force, where the ran- 
dom function ^j(f) is assumed to be Gaussian white noise, (^t(t)) = 0, 
i^i{t) = 5ij 6{t — t'). While eqs. (2), (5) refer to the particle density 

n{r, t), eq. (7) holds for each particle i = 1, ..., N. 

With respect to the simulations, the main idea is as follows: Instead of 
integrating the set of the coupled eqs. (1), (2), now the stochastic motion of 
the particles of component Cn is simulated. The advantage of this procedure 
results from the fact that in the Langevin eq. (7), the gradient Vm(r,t) 



dri dm{r,t) 
dr 
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appears only in a linear manner. Hence, for the time step the restriction 
results: 

At < 

which has to be compared to eq. (6). One could argue, that for an appropriate 
particle-based simulation of reaction-diffusion equations, a large number of 
coupled Langevin equations needs to be solved. This might be considered 
a disadvantage which compensates the advantage of a fast algorithm. But, 
as Schimansky-Geier et al. have shown [16,17] already the consideration of 
about 10^ particles results in sufficently smooth patterns. 

As another advantage, the particle-based approach is also applicable in 
cases where only small particle numbers govern the structure formation, like 
in gas discharges [25], on catalytic surfaces [14], in cell membranes [7], or 
during cell migration [15]. Here, the continuous limit becomes questionable 
and partial differential equations are not sufficient to describe the behavior 
of the system. The final pattern is path-dependent, which means it is intrin- 
sically determined by the history of its creation and irreversibility and early 
symmetry breaks play a considerable role (cf. also [20]). Hence, a stochastic 
description is needed which considers fluctuations in the system. 

2 Active Brownian Particles 

So far, we have introduced two different levels of description for the particles 
of component Cn- the “individual” description by means of Langevin eq. 
(7), and the density description by means of Fokker-Planck equation (2), 
(5) respectively. In the limit of a large number of particles, A -t oo, both 
descriptions will of course lead to equivalent results. 

The particles of component C„ are denoted as active Brownian particles. 
These are Brownian particles which motion can be described by a Langevin 
equation, but additionally, they are also active in the sense, that they are 
able to generate a self-consistent field, which in turn influences their further 
movement and physical or chemical behavior. This non-linear feedback be- 
tween the particles and the field results in an interactive structure formation 
process on the macroscopic level. Hence, these models have been used to 
simulate a broad variety of pattern formation processes in complex systems, 
ranging from physical to biological and social systems [8, 17, 19-21], 

The motion of “usual” Brownian particles would be rather considered as 
passive motion, simply because the Brownian particle does not play an active 
part in this motion. The motion of active Brownian particles, however, is 
strongly influenced by the gradients of the field created by themselves. A more 
refined description should therefore consider that the activity of the particles, 
i.e. the generation of a self-consistent field would require some energy. This 
holds especially if we want to describe phenomena such as the aggregation of 
biological species, as mentioned in the previous section. Here, the individuals 



dm(r, t) 
dr 



( 8 ) 
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of the species first need some energy in order to produce the chemical field 
used for their communication. That means the production term in eq. (3) 
should be substantiated by some energetic considerations. 

In recent papers, the concept of active Brownian particles has been ex- 
tended by considering that the active particles have the ability to take up 
energy from the environment, to store it in an internal energy depot [3, 18] and 
to convert internal energy to perform diflferent activities, such as metabolism, 
motion, change of the environment,, or signal-response behavior. The result- 
ing balance equation for the internal energy depot, e, of an active Brownian 
particle is then given by: 

^e(t) = q{r) - s - c e{t) - d{v) e{t) (9) 

q{r) shall be the space-dependent flux of energy into the depot. The internal 
energy will be decreased by three different processes: (i) generation of a self- 
consistent field m{r,t) at a rate s, (ii) internal dissipation, which is assumed 
to be proportional to the depot energy, c being the rate of energy loss, (iii) 
acceleration of motion, i.e. conversion of internal into kinetic energy, where 
the rate d{v) should be a function of the actual velocity of the particle. A 
simple ansatz for d{v) reads d{v) — d 2 V^, with ^2 > 0. 

Because of the acceleration of the Brownian particle in the direction of 
movement, the equation of motion has to consider an additional driving force, 
d 2 e{t)v [3, 18]. Hence, the Langevin equation for particle i with mass m = 1 
should read now: 



drj 

dt 



= Vi 



dvi 

dt 



-JoVi -I- d 2 e{t)v + a' 



dm{r, t) 
dr 

Vi 






( 10 ) 



Here, 70 is the friction coefRcent of the moving particle, a' = 070, and S is 
the strength of the stochastic force, which is related to the diffusion constant 
Dn via the fluctuation-dissipation theorem: S = ksTjo = ■Dn7o- 

The equation of motion for the active Brownian particles, eq. (10), is 
coupled (i) to the equation for the energy depot e{t), eq. (9), and (ii) to the 
equation of the self-consistent field m{r,t), eqs. (1), (3). We may assume 
a constant influx of energy into the internal depot, q{r) = qo, and a fast 
relaxation of the internal energy depot, eq. (9), which reads in an adiabatic 
approximation : 



go -s 
c + d 2 V^ 



( 11 ) 



The Langevin eq. (10) can then be written in the form: 



Vi = -j{v)vi + a'Vm{r,t) + ^i{t) (12) 



where 7(1;) now denotes a velocity dependent nonlinear friction function: 



7 (v) = 7o - 



(go - s) d 2 
c + 



( 13 ) 
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Dependent on the parameters 70 , d. 2 , qo, s, c, the friction function, eq. (13), 
may have a zero, where the friction is just compensated by the energy supply. 
It reads in the considered case: 



V 



2 _ 
0 — 



Qo-s 

70 



c 

d2 



(14) 



We see that for v < vq, i.e. in the range of small velocities, pumping due 
to negative friction occurs, as an additional source of energy for the Brown- 
ian particle. Hence, slow particles are accelerated, while the motion of fast 
particles is damped. 

Negative friction plays an important role e.g. in technical constructions 
or in the theory of sound developed by Rayleigh [13] already at the end of the 
last century. Here, the velocity-dependent friction function can be expressed 
as: ^ 

7(u) == -7i -I- 72 = 7i - 1^ (15) 

This Rayleigh-type model is a standard model for self-sustained oscillations 
studied also in the context of Brownian motion [10]. We note that Uq =71/72 
defines here the special value where the friction function, eq. (15), is zero (cf. 
Fig. 1). Another example for a velocity dependent friction function with a 
zero Vq introduced in [15], reads: 

7(v) = 70 (1 - (16) 



It has been shown that eq. (16) allows to describe the active motion of differ- 
ent cell types, such as granulocytes, monocytes or neural crest cells [15]. Here, 
the speed Vq expresses the fact that the motion of cells is not only driven by 
stochastic forces, instead cells are also capable of self-driven motion. 

Compared to eqs. (15), (16), the velocity-dependent friction function in 
eq. (13) is bound to a maximum value 70 reached for u — >■ 00 and avoids the 
singularity for u ^ 0 on the other hand (cf. Fig. 1). 
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Fig. 1. Different types of a velocity-dependent friction function, j(v) with a zero 
Vo- (left) eq. (15), (middle) eq. (16), (right) eq. (13). For 7 (u) < 0 “pumping” 
dominates, while for j(v) > 0 “dissipation” dominates. 



Provided a supercritical influx of energy, i.e. for no > 0, the passive mo- 
tion of “usual” Brownian particles could be transformed into active motion. 
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In this state, the energy can be used for the acceleration of the particles and 
the generation of the self-consistent field. Due to the pumping mechanism 
introduced in our model, the conservation of energy clearly does not hold for 
the active particles, i.e. we now have a non-equilibrium, canonical-dissipative 
system [6] (cf. also the paper of W. Ebeling in this book). The distribu- 
tion function P{r,v,t) which corresponds to the Langevin eq. (12) can be 
described by a Fokker-Planck equation of the form: 



dP{r,v,t) 

dt 



dv 



|7(v)v P(r,v,t) -I- S 
dP{r,v,t) 



dP(r 



I 



dr 



-I- a'Vm(r) 



dv 

dP{r,v,t) 

dv 



(17) 



In [5], we have investigated the solutions of eq. (17) for different special cases, 
which also include the nonlinear friction functions of eqs. (13)-(16). For a sub- 
critical pumping of energy, we found an unimodal velocity distribution. This is 
the case of the passive mode of motion which corresponds to the Maxwellian 
velocity distribution. However, for supercritical pumping, a crater-like velocity 
distribution results, The corresponding active mode for the stationary motion 
is described by strong deviations from the Maxwell distribution. This active 
mode of motion will be further investigated in the following section. 



3 Motion of Active Brownian Particles 
in External Potentials 

Active motion is of interest for the dynamics of driven systems, such as 
physico-chemical [12] or biological [15] systems. However, recent models on 
self-driven particles often neglect the energetic aspects of active motion while 
focusing on the interaction of particles [1,9, 24]. In our model, the interaction 
between the active particles is decribed by the self-consistent field, m{r,t) 
generated by them. The coupling parameter s represents the amount of en- 
ergy per time unit, which each particle spends on its interaction with other 
particles. Instead of a self-consistent field, the interaction between the parti- 
cles may be also described by an interaction potential, e.g. a Toda potential 
[11]. Alternatively, we may also consider the interaction via global coupling, 
e.g. via invariants of the system, such as the total momentum or the total 
angular momentum [4], 

For the further discussion, we will neglect the interaction of the particles 
via a self-consistent field, i.e. s ^ 0. The spatio-temporal field m(r, t), which 
is not created in this case, shall be replaced by a time-independent spatial 
potential U{r), which may result in an external force on the particles. As- 
suming again that the internal energy depot of the active particles relaxes 
fast, the resulting Langevin equation reads now: 






( 18 ) 
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Let us first discuss the deterministic case. With 5 = 0 and F — — Vt/(r), 
the stationary solutions of eq. (18) result from the equation: 




- d,2Fvo - {qod2 - cjo) 



Vo = cF. 



(19) 



Depending on the value of F and in particular on the sign of the term 
(qod 2 — cjo), eq- (19) has either one or three real solutions for the statio- 
nary velocity, Vq- The always existing solution expresses a direct response 
to the force in the form: no(r) ~ -f’(f)- This solution results from the ana- 
lytic continuation of Stokes’ law, «o = F/jo, which is valid for d 2 = 0. We 
will denote this solution as the “normal response” mode of motion, since the 
velocity v has the same direction as the force F resulting from the external 
potential U (r). As long as the supply of the energy depot is small, we will also 
name the normal mode as the passive mode, because the particle is simply 
driven by the external force. More interesting is the case of three stationary 
velocities, dq, which significantly depends on the (supercritical) influence of 
the energy depot. In this case, the particle will be able to move in a “high 
velocity” or active mode. 





Fig. 2. (right) Sketch of the one-dimensional motion of the particle in the presence 
of a constant force F = — V17(x) =const. (left) Stationary velocities Vo, eq. (19), 
vs. conversion rate da- Parameters: F = 4-7/8, go = 10, 70 = 20, c = 0.01. [22] 



In order to elucidate this, we consider the case of a one-dimensional linear 
potential U (x) = —ax as shown in Fig. 2. The energy supply from the internal 
depot is described by the parameter ^ 2 - Fig. 2 shows that with increasing 
^2 the former passive normal mode, which holds for subcritical energetic 
conditions, is transformed into an active normal mode, where the particle 
moves into the same direction, but with a much higher velocity. Additionally, 
above a critical value of d 2 , in the active mode a high-velocity motion against 
the direction of the force F becomes possible. This is indicated in Fig. 2 
by a negative stationary velocity which corresponds to an “uphill” motion. 
We note that a stability analysis for the “uphill” motion and a detailed 
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investigation of the critical energy supply has been carried out in [22] , while in 
[22, 23] applications to a piesewise linear periodic potential (ratchet potential) 
have been discussed. For instance, above a critical energy supply we observed 
the directed motion of an ensemble of active Brownian particles. 

Let us eventually discuss the motion of active Brownian particles in a 
two-dimensional parabolic potential: 



U{xi,X 2 ) = ^a{xl + xj) (20) 

For a subcritical supply of energy, the particles position will fluctuate around 
the origin of the potential. For a supercritical supply, however, we find the 
motion of the particles on a stochastic limit cycle [3, 5, 18]. This is also shown 
in Fig. 3 for an ensemble of active particles which start with an empty inter- 
nal energy depot. In this particular simulation, the initial position was the 
same for all particles and different from the potential minimum. Thus, for in- 
termediate times, the motion of the particle ensemble reminds on swarming, 
i.e. a coherent motion with slow spatial dispersion. After an inital stage, we 
find the occurence of two branches of the swarm which results from a symme- 
try break (cf. Fig. 3 a). These two branches will, after a sufficient long time, 
move on two limit cycles (as already indicated in Fig. 3 b). One of these limit 
cycles refers to the left-handed, the other one to the right-handed direction 
of motion in the 2d-space. 





Fig. 3. Snapshots of a swarm of AT = 2000 active Brownian particles moving in a 
two-dimensional potential, eq. (20). (left) t = 15, (right) t = 99. Initial conditions 
for all particles: x\ = 0.0, X 2 = 0.5, vi = 0.0, V 2 = 0.0, e(0) = 0. Parameters: 
qo = 10; c = 1.0; 70 = 20, (I 2 = 10. [4] 



The radius of the limit cycles obeys the relation [5]: 




V 



2 

0 



a 



(21) 
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where vq is the stationary velocity of the particles on the limit cycle. It has 
been shown [3] that for the case of a parabolic potential, vq has the same 
value as for the force-free case (U = 0), namely: 



2 _ % _ 

^0 ~ j 

7o d 2 



(22) 



The total mechanical energy of an active particle moving on the limit cycle 
can then be expressed as: 




:Vn + 




(23) 



In [3] we have shown that any initial value of the energy converges (at least 
in the limit of strong pumping) to 



H ^Eo=vl 



(24) 



This corresponds to an equal distribution between kinetic and potential en- 
ergy, i.e. similar to the harmonic oscillator in one dimension, both parts 
contribute the same amount to the total energy. We note that the theoretical 
results of eqs. (21)-(24) agree perfectly with the results of computer simula- 
tions of N active particles which move according to the Langevin eq. (10), 
coupled with eq. (9) for the internal energy depot. 
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Abstract. In most of the literature on granular gases it is assumed that the resti- 
tution coefficient e, which quantifies the loss of kinetic energy upon a collision is in- 
dependent on the impact velocity. Experiments as well as theoretical investigations 
show, however, that for real matericJs the restitution coefficient depends signifi- 
cantly on the impact velocity. We consider the diffusion process in a homogeneous 
granular gas, i.e. in a system of dissipatively colliding particles. We show that the 
mean square displacement of the particles changes drastically if we take the impact 
velocity dependence of e into account. Under the oversimplifying assumption of a 
constant coefficient one finds that the particles spread in space logarithmically slow 
with time, whereas realistic particles spread due to a power law. 



1 Introduction 

Granular gases, i.e. gases composed of particles of mesoscopic or macroscopic 
size which suffer inelastic collisions, may be described under certain assump- 
tions by the same quantities as common molecular gases. One can define for 
these systems temperature, density, velocity field, etc., and describe them 
within the framework of hydrodynamics. Due to the inelasticity of the parti- 
cles, however, there emerge new additional time and length scales. 

From a phenomenological point of view, granular gases behave very dif- 
ferently from molecular gases. One observes cluster formation, e.g., [1-4] and 
vertexes, e.g., [5] during the evolution of an initially uniform granular gas. 
Although plausible explanations of these effects exist, [1-3,5] they still lack 
a comprehensive theory. 

Starting from a homogeneous state, all structures in granular gases de- 
velop after some time-lag. Before noticeable inhomogeneities appear the gas 
evolves in the homogeneously cooling state (HCS), when it gradually loses its 
energy according to inelastic collisions. During this regime of the evolution 
the gas is completely described by the current temperature (which decreases 
with time) and by the velocity distribution function. The HCS which precedes 
all further states of evolution, as e.g. clustering, is the most simple state of 
a granular gas. Understanding the physics of the HCS might, therefore, shed 
some light on more complex phenomena such as cluster and vortex formation. 
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In the present study we focus on the diffusion processes in granular gases 
being in the HCS. We consider the case of a constant restitution coefficient, 
which frequently is assumed in literature but turns out to be an oversimplified 
model of a real collision, and impact-velocity dependent restitution coefficient 
as it is valid for viscoelastic particle interaction. 



2 Collision of Particles 



The microscopic dynamics of granular particles is governed by the (normal) 
restitution coefficient e which relates the normal components of the particle 
velocities before and after a collision, Uy = Vi — Vj and v'- = v[ — Vj by 



V ■ -e 
V 



VijE 



The unit vector e = Vy/\ry\ gives the direction of the 
inter-center vector = ri — rj at the instant of the collision. Prom the 

conservation of momentum one finds the change of velocity for the colliding 
particles; 



Vi = Vi 



(1 + e) 



Vj = Vj + 



i(l-fe) (vij'e'^e. 



( 1 ) 



For elastic collisions one has e = 1 and for inelastic collisions e decreases with 
increasing degree of inelasticity. 

In literature it is frequently assumed that the restitution coefficient is a 
material constant, € = const. Experiments, e.g. [6], as well as theoretical in- 
vestigations [7] show, however, that this assumption is not consistent with 
the nature of the inelastic collisions, it does not agree even with a dimension 
analysis [8]. The impact velocity dependence of the restitution coefficient 
e has been obtained by generalizing Hertz’s contact problem to vis- 

coelastic spheres [7]. From the generalized Hertz equation one obtains the 
velocity-dependent restitution coefficient [9] 



e = l~ Cl 




a 



, 2/5 



e Vi 



1/5 



+ C2 




e Vi 



2/5 



T-' 



( 2 ) 



with 

_ 2 

3 m^ff (1 — 1/2) ’ 



(3) 



where Y is the Young modulus, i/ is the Poisson ratio, and A depends on dis- 
sipative parameters of the particle material (for details see [7]). The effective 
mass and radius are defined as 



R'^ff = RiR2/{Ri + R 2 ) = mim2 1 {mi + m 2 ) (4) 



with Ri /2 and mi /2 being the radii and masses of the colliding particles. The 
constants are given by [8,9] 



Cl = 



^(3/5)A 

21/552/5j-(2i/io) 



1.1534 



C. = 



0.7982 . 



(5) 
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Equation (2) refers to the case of pure viscoelastic interaction, i.e. when the 
relative velocity \vije\ is not too large {to avoid plastic deformation of the 
particles) and is not too small (to allow to neglect surface effects such as 
roughness, adhesion and van der Waals interactions). 

3 Granular Gas Dynamics 

The diffusion equation 



JA{r) = -DAVnA{r) 



( 6 ) 



describes the current J^(i’) of particles of sort A at position r against the 
density gradient ^nA{r) with Da being the diffusion coefficient. Using the 
continuity equation 



dnAjr) 

dt 



-VJa{t) 



(7) 



we obtain the “canonical” diffusion equation: 



driAir) 

dt 



DAV^riAir) ■ 



( 8 ) 



Usually the term diffusion refers to the motion of a species of particles A in 
a “solution” of other particles B. It is also possible, however, that A and B 
are of the same type, distinguishable only by a feature which does not affect 
the mechanical properties, i.e. mechanically A and B are indistinguishable; 
one may think of A and B having different colors. The process of diffusion of 
tagged particles among mechanically identical ones is called self-diffusion. 

The diffusion (and self-diffusion) coefficient is closely related with the 
mean square displacement of tagged particles with time. Assume the tagged 
particles are located at time f = 0 in the origin r = 0. Then one can write 
for the square average displacement of particles at time t: 



{[rit]?) = j dr[r{t)f 




drnA{r) 



(9) 



where nA(r,t)/ f drriA{r,t) is the fraction of particles A located at r at 
time t. (Note that J drnA{r,t) = N = const is the total number of tagged 
particles.) Now we multiply both sides of Eq. (8) with and integrate over 
dr. Using two times integration by parts and definition (9), one obtains for 
3D-systems 

^ ([r{t)]^'j = 6DAt. (10) 

Using the kinematic relation r{t) = v{t')dt', one obtains 

([r(t)]^) = v{t')dt' v{t”)dt"'^ 



( 11 ) 
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and encounters with the velocity autocorrelation function (VAF) (v(t')v(t")). 
For gases in equilibrium the VAF depends only on the time difference, \t' -t''\ 
and decays with a characteristic time r„. Using these properties of the VAF, 
one can perform time-integration in (11) for f 3> r,,, i.e. for t oo. Taking 
into account (10) one obtains the basic relation 

1 

Da = -J^ {v{0)v{t))dt. (12) 

Although not stated explicitly, all the above discussion refers to the case 
of equilibrium gases. Granular gases are a priori non-equilibrium systems, 
nevertheless, the concept of the diffusion coefficient may be generalized for 
such systems. Obviously, this refers only to “liquid” or gaseous phases of 
the material [10] where the particles are highly mobile. As discussed in the 
introduction throughout this article we assume that the granular material is 
homogeneous and isotropic (HCS). 

Another quantity which we will need below is the “granular temperature” 
T(f), which decreases with time due to the loss of kinetic energy according to 
inelastic collisions. If the particles do not lose too much energy in a collision, 
the temperature changes on a time-scale tq, which is much larger than the 
mean collision time Tc, i.e. tq ^ Tc [11]. This condition allows for the defini- 
tion of temperature, but imposes some restrictions for the intervals of time 
and values of material parameters. For a full discussion see [11]. 

Whereas the diffusion coefficient D for equilibrium systems is just a con- 
stant, the time dependence of temperature causes the diffusion coefficient to 
be time dependent too. Therefore, the natural generalization of the diffusion 
coefficient for nonequilibrium systems is the diffusivity 

i^{Ar{t)f)=Q j' D{t')dt' . (13) 

The brackets (• • •) denote averaging over the non-equilibrium ensemble, which 
evolution is described by a time-dependent iV-particle distribution function 
p{t) (for simplicity we left the same notation as for the equilibrium average). 

4 The Pseudo— Liouville Operator 

To describe the dynamics of the granular gas we use the formalism of the 
pseudo-Liouville operator C [12, 13]. This formalism allows to treat the dy- 
namics of a system of particles with hard-core (i.e. singular) interactions 
formally in the same way as if the particles would interact via a smooth po- 
tential. In classical mechanics the time derivative of any dynamical variable 
B reads 






(14) 
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where {. . . ,1-i) denotes the Poisson brackets, which imply differentiation of 
the Hamiltonian with respect to the coordinates. For singular inter-particle 
potentials, like a hard-core potential, Poisson brackets are not well defined. 
Nevertheless a Liouville-like operator may be defined: 

= + (15) 

J ^ i<j 

The first sum in (15) refers to the free streaming of the particles (the ideal 
part), while the second sum refers to the interactions of pairs of colliding 
particles {i,j} which are described by the binary collision operator [14]: 

Tij j ^ ^ ® {^ij - - l) • (16) 

Here it = 2H is the diameter of particles and v^j ■ e = {vi - Vj) ■ e is the 
normal component of the relative velocity of the colliding pair (which, multi- 
plied by the infinitesimal time dt, gives the length of the collision cylinder). 
The Heaviside function 0{x) selects approaching particles and the (5-function 

represents the hard-core interaction. The operator S® is defined as 

y 

= , (17) 

where / is some function of dynamical variables. The after-collision velocities 
of the colliding particles, v- and uj are related to their pre-collision values 
Vi, Vj via Eq. (1). 

The pseudo-Liouville operator allows to perform calculations in a very 
elegant way: Formal integration of Eq. (14) yields for {t > t')\ 

B{{ri,Vi),t) = e'^(*-*-">B{{ri,Vi],t') . (18) 

With (18) the time-correlation function reads 

(B{t')B{t)) = J drp{t')B{t')e^^^*-^'^B{t') , (19) 

where f dF denotes integration over all degrees of freedom and p{t') depends 
on temperature T, particle number density n , etc., which change on a time- 
scale t » Tc. In accordance with the molecular chaos assumption at t ~ Tc 
the sequence of successive collisions occurs without correlations. If B does 
not depend on the positions of the particles, its time-correlation function 
reads [15] 

{B{t')B{t)) = (B^)^, e {t > t') , (20) 

where {■■ -)t' denotes averaging with the distribution function taken at time 
t' . The relaxation time tb is inverse to the initial slope of the VAF [15]. It may 
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be found from the time derivative of {B{t')B{t)) taken at t = t'. Eqs. (19) 
and (20) then yield 

= j drp{i)BiCB HB'),, = < 2 ^ . ( 21 ) 

The relaxation time which depends on time via the distribution func- 

tion changes on the time-scale Tc- 



5 Velocity Autocorrelation Function 
and Self— Diffusion Coefficient 



5.1 Constant Restitution Coefficient 6 



Following the idea described in section 3 we calculate the velocity autocor- 
relation function and the self-diffusion coefficient. In the previous section we 
discussed a method to calculate the evolution of a general dynamic function 
B{t). Now we specify B{t) to be the velocity of a tagged particle, say Vi{t). 
Then with 3T{t) = {v^)^ Eqs. (20,21) (with (15,16)) read 

( 22 ) 






(tJl ■Vl)^, 



(23) 



To obtain (23) we take into account that = 0i — 0 (for i ^ 1) and 
the identity of the particles. The calculation of may be performed if 

we assume that the distribution function p{t') is a product of the coordinate 
part, which corresponds to a uniform and isotropic system, and the velocity 
part being a product of Maxwellian distribution functions 



4>{vi) 



exp[-vf/2T{t')] 






(24) 



We want to mention that a more sophisticated analysis (e.g. [16, 17]) shows 
that the velocity distribution function deviates from the Maxwellian. In this 
paper we neglect these deviations which are small for small inelasticity of the 
particles (e — > 1). Calculation of the diffusion coefficient with non-Maxwellian 
velocity distribution function has been performed in [18]. The result (depend- 
ing on the inelasticity) may differ quantitatively from that given here, but 
its functional form remains unaffected/ 

Integration over the coordinate part in (23) yields 



(A - 1) J p{t')5 (r^j - ae^ dr^ - dr^ = ng2{(r) (p{vi ) , 



(25) 
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where we use the definition of the two-particle distribution function and where 



32(0-) = ^(2-»i)/(l -t ?)3 



(26) 



is its contact value [13, 15], which depends on the packing fraction t] = h 



irna 



With 



(vifi2Vi'^^^ = ^(vi2Ti2V: 



(27) 



due to the collision rules and definition (16) one finally arrives at 



O -e|(^ 

47 J {vi-Vi)^, 

(28) 

where 

^{Vi2) = (47rT)“^7^exp(-Vi2/4T) (29) 

is the Maxwellian distribution for the relative velocity of two particles. For e 
not depending on U 12 Eq. (28) yields 



= ^^rj5^(f) , (30) 

where Tsit) = | Tc(t) is the Enskog relaxation time [13]. For the granular gas 
it depends on time according to the same time-scale as temperature. Accord- 
ing to Eq. (30) the velocity correlation time for inelastic collisions is larger 
than for elastic collisions. This follows from partial suppression of backscat- 
tering of particles due to inelastic losses in their normal relative motion. As 
a result for inelastic particle interaction the angle between crossing trajec- 
tories after a collision is smaller than before the collision, while for elastic 
interaction both angles are identical. Therefore, the velocity correlation time 
is larger for inelastically colliding particles. 

Using the velocity correlation function one writes 









(31) 



On the short-time scale t ~ r^, T{t') and r„(t') may be considered as con- 
stants. Integrating in (31) over t" and equating with (13) yields for t Tc ^ 
Ty the diffusivity (time-dependent self-diffusion coefficient) 



D{t) = T{t)Ty{t) . 



(32) 



Using the pseudo-Liouville operator one can also describe the time-depen- 
dence of the granular temperature: From (14) it follows (see also [19]): 



( 33 ) 
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Calculations similar to that for T„(t) yield 

m = - - e") (34) 

So that finally one obtains a well known result for temperature 

T(^)/^o = [l+7o^/rc(0)]-^ (35) 

where 70 = (1 — e^)/6 [1,5], To is the initial temperature at t = 0, and 

Tc(0) = 4n^^‘^g2{(r)a'^ny/T^ (36) 

is the initial mean collision time. Thus, using Eqs. (30) and (32) one obtains 
for the self-diffusion coefficient for the case e = const. 

D(t) = Do [1 + 7of/re(0)]-' (37) 

where Do is the Enskog self-diffusion coefficient for elastic particles; 

Do^ = ^33) 

Correspondingly, the mean-square displacement reads for t » Tc(0): 

^(Zir(t))^^ ~ logf . (39) 

5.2 Impact Velocity Dependent Restitution Coefficient 

As fnentioned before the assumption of a constant restitution coefficient con- 
tradicts basic physical understanding and does not even agree with a dimen- 
sion analysis [8] . Nevertheless it was used in many publications for simplicity 
of the calculation. In this section we will calculate the diffusivity for a gas of 
viscoelastic particles for which e is given by Eq. (2) and, surprisingly, we will 
find a qualitatively different result. 

The velocity correlation time r„ can be found from Eq. (28) where e 
depends on the impact velocity as described by Eq. (2): 

r-\t) = [l - (4r(t))i/^° -f 

+ ~r (4T{t)f^ T • • • , (40) 

where r{x) is the Gamma-function, te is given by Eq. (30) and we use 
Eq. (5), which relates the coefficients Ci and C2. 

Performing calculations similar to those for the constant restitution coef- 
ficient, one obtains for the time evolution of temperature 

t/To = -(5/3)rQ-^ [{T/Tof!^ - 6<5 (T/Tq)'^/!® + . . . 



(41) 
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where we introduce the small (dissipative) parameter 

<5 = , (42) 



the characteristic time for the temperature evolution 






0.831928- J-Te(0)“^ 



(43) 



and the numerical constant b = (18/5)2^/^C'ir(l/5)/r(l/10) ss 2.3018. Solv- 
ing Eq. (41) and expanding the result in terms of the small parameter S yields 



m 

To 




+ cii S 





-f 0,2 




+ (44) 



with ai and U2 being pure numbers [20]. 

From Eqs. (32,44,40) follows for the self-diffusion coefficient: 



T>o 




+ as S 




-f ^4(5^ 




(45) 



where Dq is given in Eq. (38) and 03, 04 are pure numbers [20]. Correspond- 
ingly, the mean-square displacement reads for tq -C t: 

^(zlr(t))^^ + 035 logt. (46) 

This dependence holds true for 

Te(0)<J-i <^<rc(0)r“/^ (47) 



where the first inequality follows from the condition tq <^t, while the second 
one follows from the condition Tc(t) tq which makes the concept of the 
temperature meaningful. 

Comparing Eqs. (46) and (39) one notes that the impact-velocity depen- 
dent restitution coefficient (2) leads to a significant change of the long-time 
behavior of the mean-square displacement of particles in time. Compared 
to its logarithmically weak dependence for e = const, (simplified collision 
model) , the impact- velocity dependence of the restitution coefficient (2) as it 
appears for viscoelastic particles gives rise to a considerably faster spreading 
of particles according to a power law. 



6 Results and Discussion 

We studied the diffusion of particles in a homogeneously cooling granular 
gas. With the assumption of molecular chaos we calculated the velocity time- 
correlation function and the time dependent self-diffusion coefficient (diffu- 
sivity) D(t). For the case of constant coefficient of restitution e = const, the 
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diffusivity D{t) is expressed in terms of the model parameter e. For the more 
realistic case of an impact velocity dependent restitution coefficient, as it has 
been derived for viscoelastic particle interaction, we found a relation which 
expresses the diffusivity in terms of material constants of the particles and 
characteristics of the granular gas, such as temperature, density, etc. 



For granular particles suffering viscoelastic collisions we found that the 
mean-square displacement grows with time as a power law ~ 



i.e. much faster than the logarithmic growth ~ logt for the case 

of a constant restitution coefficient. It worth to note that qualitatively this 



power-law dependence (as well as the logarithmic one) simply follows from 
scaling arguments and the time-dependence of temperature. Indeed, the av- 
erage velocity scales as v ~ and therefore as ~ for the constant 

restitution coefficient and as ~ for the impact- velocity dependent coef- 
ficient. The diffusivity in granular gas scales as D ~ where I ~ a~^n ^ 

is the mean-free path, which does not change with time (in the regime preced- 
ing clustering), and Tc ~ //u is the mean-collision time. Thus, D ^ Iv ^ 
and we obtain that the mean-square displacement, D{t)dt, scales as ~ logt 
in the former case and as ~ in the latter. 



What will be the impact of this apparently dramatic difference in the 
time dependence of (^{Ar{t)f'^ for the properties of granular gases? Obvi- 
ously, viscoelastic particles spread (and, therefore, mix) quicker than particles 
which interact via e = const. Since the temperature decreases more slowly 
for the former case, as ~ as compared with ~ for the latter one, 

retarded clustering may be expected. Let us explain this in more detail: Ac- 
cording to the linear stability analysis [1,4], long-range density fluctuations 
in homogeneous granular gas occur to be unstable, i.e. they grow exponen- 
tially with time, leading to cluster formation. The critical value of the sta ble 
wavelengths Ac = 2n/kc (k is the wave number) reads Ac ~ l/\/l - [1], 

see also [4]. All density fluctuations with A > Ac are unstable. For the case 
of viscoelastic particles the effective value of e permanently grows with time 
(as temperature decreases), and Ac grows accordingly. This implies that the 
size of the regions, where the gas is still homogeneous, grows with time, since 
density fluctuations do not blow up on length scales smaller than Ac. Thus 
for the velocity-dependent restitution coefficient the critical wavelength in- 
creases with time (i.e. one has a time-dependent criterion for the size of the 



region which is unstable in the HCS). As compared to the case e — const., 
clustering occurs on a larger length-scale; hence the conditions to remain in 
the homogeneous medium persist for a longer time for viscoelastic particles. 



Obviously, self-diffusion directly counteracts clustering. Therefore, we con- 
clude, that for a granular gas of viscoelastic particles which implies an impact 
velocity dependent restitution coefficient, clustering is retarded as compared 



with a gas under the oversimplified assumption e = const. 



We thank M. H. Ernst and I. Goldhirsch for valuable discussions. 
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Abstract. We show how scaling arguments can be applied to analyze the dynamics 
of stochastic systems that are periodically modulated by an input signal. Informa- 
tion about the behavior of the relevant quantities, such as the signal-to-noise ratio, 
upon variations of the noise level can be obtained by analyzing the symmetries and 
invariances of the system. By means of this methodology, it is possible to predict 
diverse physical manifestations of the cooperative behavior between noise and input 
signal, as for instance, stochastic resonance and stochastic multiresonance. 



1 Introduction 

Scaling arguments have proved to be very useful to analyze complex situa- 
tions with little effort, without entering into intricate calculations [1]. This 
is achieved by simple manipulations which are able to relate to each other 
the relevant quantities of the system. Thus, scaling arguments have been 
successfully applied in many classical branches of Physics, such as critical 
phenomena [2,3], hydrodynamics [4,5], polymer physics [6] and non-linear 
physics [7,8]; more recently, they have also been used in other fields, such as 
growth phenomena [9], fractures [10], and economy [11], to mention just a 
few. 

Here, we show how scaling arguments can be applied to analyze the dy- 
namics of a wide class of systems whose dynamics is both modulated periodi- 
cally and affected by noise. In particular, we will focus on the possibility that 
the behavior of the system may be enhanced by the addition of noise. This 
phenomenon, known as stochastic resonance (SR) [12-20], shows a construc- 
tive role of noise. This is one of the most counterintuitive facets of noise, since 
it is able to decrease the randomness displayed by the system. It has been 
found that SR can appear in a great number of different situations; ranging 
from systems as simple as a single dipole [21] to systems exhibiting certain 
degree of complexity, such as neural tissues [22] or pattern-forming systems 
[18]. Along this paper we present a methodology based upon general scaling 
arguments which enables one to predict the appearance of such an ordered 
behavior due to the presence of noise. 
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2 Preliminary Concepts 

The dynamic evolution of the systems we study belongs to the following type: 

dx 

- = F{x,t)+m , ( 1 ) 

where F{x,t) is a function of x and t, periodic on t with period 27r/wo; 
and ^(t) is Gaussian white noise with zero mean and correlation function 
+ t)) = 2DS(t), defining the noise level D. 

Frequently, the variable that enters the dynamic equations is not the 
quantity we are interested in. For instance, if we are dealing with dipoles in a 
magnetic field, the dynamics is given by the angle between the dipole and the 
magnetic field. The representative quantity, however, is not the angle but the 
component of the magnetic moment along the field. In general, the system is 
described by a function v{t) of the dynamic variable x; i. e., v{t) = v[x{t)]. 
In the case of the dipole, x would be equal to the angle 6 whereas v would 
be proportional to cos(^). 

The response of the system to the periodic component of the force F{x, t) 
can be analyzed by the averaged power spectrum, 

Uln roo 

-P(^) — 7 ^ + ^)) dr . (2) 

Jo J-oo 

To this end we will assume that it consists of a delta function centered at the 
frequency wq plus a function Q(uj) which is smooth in the neighborhood of 
Wo and is given by 

P(w) = Q{lj) + S(u)o)S{u! - Wo) . (3) 

We have expressed the power spectrum in this form since we are interested in 
the behavior of the system in the range of frequencies close to the frequency of 
the input signal. Thereby, the power spectrum explicitly shows the intensity 
of the deterministic component of the system or output signal, S'(wo), and 
the stochastic component or output noise, <5(w). The SNR, defined as the 
ratio between the signal and noise, 

SNR = 5(wo)/Q(wo) , (4) 

then indicates the order present in the system. 

3 Linear Systems 

Let us start by discussing in detail the simplest case, which can be treated 
exactly by using dimensional analysis: the periodically modulated Ornstein- 
Uhlenbeck process. Here, the input signal modulates the strength of the force 
in the following way: 

dx 

— = -k[ 1 + asin(wot)]a; + ^{t) , 



(5) 




Scaling of noise and constructive aspects of fluctuations 



123 



where k, a, and ojq are constants. In spite of its simplicity, the previous model 
encompasses many physical situations of interest since it describes the motion 
around a minimum in a force field whose intensity varies periodically in time. 



3.1 Dimensional Analysis 

Let us now assume the explicit form for the output of the system u(a;) = \x\^ , 
where is a constant. Considerations based upon dimensional analysis enable 
us to rewrite the averaged power spectrum as 

j q{uj/uio,K/LJo,a,^) 

+ (f) . 

( 6 ) 



P{uj,D,K,a,uo,P) = - ( — 

K \ K 



where q{u}/ojo, k/ojq, q) and s{k/u>q, a) are dimensionless functions. Note that 
the previous equation is an exact expression for the power spectrum. 

From Eq. (6) we can identify the expression for the output signal: 

/ D\^ 

5(wo) = f — j s{K/uo,a,P) . (7) 

In this way, we have easily obtained the exact dependence of the output signal 
with the noise level. Notice that the output signal depends on the quantity we 
measure and, consequently, on the exponent 0 [23]. In this respect, inspection 
of Eq. (7) reveals the presence of three qualitative different situations. For 
/3 > 0 the signal diverges when the noise level D goes to infinity, whereas for 
/? < 0 the signal diverges when D goes to zero. In the limit case = 0, the 
signal does not depend on the noise level. 

The expression for the SNR follows from Eq. (6), 



SNR= K 



s{K/u)o,a,l3) 

q{u}lu)o,n/ujo,a,0) 



( 8 ) 



In contrast to the case for the signal, this result does not depend on the noise 
level thus indicating that the system is insensitive to the noise. No matter 
the noise intensity, the SNR has always the same value despite the fact that 
signal is a monotonic increasing or decreasing function of the noise level. 



3.2 Scaling 

To illustrate how the behavior of the system is modified upon changes on the 
noise level, in Fig. 1 we have depicted the time evolution of the output of 
the system for v(x) = x and two different values of the noise level. In both 
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0 20 40 60 80 100 

t 

Fig. 1. Time evolution of x (k = 1, a = 0.5, and = 0.1) for the noise levels 

(a) D = 0.01 and (b) D = l. 



cases we have used the same realization of the noise. In this figure one can see 
how the noise only affects the system by changing its characteristic scales. 
Therefore, the dependence of the quantities of interest with the noise level 
can also be obtained from the inspection of the invariance properties of the 
equations under scale transformations. Thus, when rescaling the noise level, 
X, and t in the following way: 



D ^D' = bD , 

X x' = b'^^x , 
t ->t'= WH , 



( 9 ) 
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Eq. (5) must be independent of b for the adequate values of the exponents 
7 i and 72 . Consequently, by substituting Eqs. (9) into Eq. (5) we obtain 

6^1 ^ = -k[1 + a smiuob-^HW^x + 6V2-72/2^(^) ^ (10) 

which is left unchanged when 71 =1/2 and 72 = 0. Since the power spectrum, 
given in Eq. (2), transforms under the scaling (9) as 

P'(cj') = + 62dm5(^^)j(^' _ ^') ^ (11) 

then, the output signal and SNR scale with the noise level as 5(wo) ~ 
and SNR~£>°. 



4 Nonlinear Systems 

The results we have obtained so far are exact since no approximations has 
been made. In order to analyze more interesting situations, a similar scheme 
can be followed. However, some assumptions about the behavior of the quan- 
tities of interest should be made. In the following, we will discuss some of 
such situations. 

4.1 Scale Invariant Potentials 

We consider the class of systems described by the following Langevin equa- 
tion: 

^ = -k[ 1 + asm{uot)]x^+^^ + m , ( 12 ) 

at 

where k and a (< 1 ) are constants and n is an integer number. 

Let us assume that v{x) does not introduce any characteristic time, as 
occurs when v{x) = \x\^ . Since the SNR has dimensions of the inverse of 
time, it follows from the simple scaling law 

SNR = /(a,wor)T-^ , (13) 

where characteristic time r is given by and f{a,uiQT) 

is a dimensionless function. We assume that for a given value of t the limit 
of the SNR when wq goes to zero exists. As such, the following expression for 
small driving frequencies holds 

SNR = /(a,0)r“^ (14) 

The main characteristics of this model upon varying the exponent n are 
as follows: if n = 0, this system is equivalent to the one corresponding to Eq. 
(5), then one finds the result SNR = /(a, wok“^)k, which does not depend 
on the noise level as shown in Sec. 3; for the case n > 0, the scaling of 
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the SNR indicates that it increases when the noise level increases, achieving 
the behavior SNR ~ D as n goes to infinity. The only assumption introduced 
here concerns to the existence of the SNR in the limit case of frequency of the 
external signal going to zero. A particular and common situation illustrating 
this case corresponds to a quartic potential, obtained when n = 1, for which 
the SNR increases as VD. 

4.2 Breaking of Scale Invariance 

The class of systems discussed previously is characterized by the dynamics 
coming from scale invariant potentials. In this section we will show that 
scaling arguments can also be applied when that requirement is not fulfilled. 

We will first analyze the case of low noise level. To be explicit, we will 
consider the Langevin equation 

dx 

— = -k[ 1 + a sin(o;o^)] {x + • (15) 

When the noise level is sufficiently small the nonlinear term can be neglected. 
Then, the SNR does not depend on D. In order to analyze how the SNR be- 
haves upon varying D, we must take into account the nonlinear term. To this 
purpose, we will assume that the effects of the nonlinear contribution 
on a given quantity, the SNR in this case, can be replaced by the ones of 
an effective linear term abD^K~'^x, where h = 6(q,wok“^) is a dimensionless 
positive function. The explicit form of b may depend on the quantity we are 
considering but it is always a positive function. Consequently, the previous 
equation transforms into 

dx 

— = -K (l + [1 + asin(wof)] a; + ^(*) , (16) 

which can be rewritten in the form 
dx 

— = -k[ 1 -h asin(wof)]a: -I- ^{t) , (17) 

where /t = (1 -f abD^n~^)k is an effective parameter. The SNR is then 

SNR = /(a,u;o/t“*)K , (18) 

which for small frequencies 1) leads to 

SNR = /(a, 0 )k (1 -h abD^K-^) , (19) 

Thereby, have found the behavior of the SNR as a function of the noise level 
by simple scaling arguments. It is interesting to point out that for low noise 
level, when a is positive, the SNR is an increasing function of D, whereas 
when a is negative the SNR decreases with D. Thus, if the SNR decreases 
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for high noise level, as usually happens, the system may exhibit SR when its 
dynamics around the minimum of the potential can be approximated by Eq. 
(15) with a positive. 

The high noise level limit can also be treated by means of scaling argu- 
ments. To this purpose, we will assume that the dynamics of the system in 
this case may be approximated by 

dx 

— = -K[l + asm(LjQt)]x’^ -Ix"^ +^{t) , (20) 



where I, n, and m are positive constants. If n = m, Eq. (20) is equivalent to 
Eq. (12), as follows by just changing the values of the parameters. If n > m, 
Eq. (20) also leads to Eq. (12), since, for high noise level, the term lx"^ can 
be neglected when n> m. Therefore, we consider the case in which n <m. 
The previous equation can be rewritten in the following way: 



dx 

dt 



= -I 



1 + 



lx’"' 



KOI 

+ smiwnf ) 

Ixm-n V u J 






(21) 



Since for high noise level x is large (a; ~ £)i/(i+»"))^ the periodic force acts as 
a small perturbation to the dynamics of the system. Proceeding in a similar 
way as in the case for low noise level, one can introduce the effective parameter 
a = bl (m-n)/{i+m)^^ with b now a dimensionless constant. 

Since the term k/{Ix"'-'^) can be neglected, Eq. (21) reads 

dx 

■^ = -f[l-i-dsin(a>of)]ar'"+^(t) , (22) 

which has the same form as Eq. (12). We then obtain 

SNR = /(d,o;oT)r“^ , (23) 

with r = £)-("*-l)/(l+m)/- 2 /(l+m) 
then 

SNR=i/"d2r-i , (24) 

where /" is the second derivative of /(d,wor), with respect to a, evaluated 
at d = 0 and cjqt = 0. Explicitly, 

SNR= l/"a^«;262r2"/(i+m)/)-i+2n/(i-h™) _ ^25) 

Note that when the forcing term does not depend on x, L e. n = 0, the 
SNR always decreases as SNR ~ l?-\ irrespective of the value of m. From 
this expression one can elucidate some interesting situations. For instance if 
m = 2n— 1, the SNR tends to a constant value for high noise level, whereas if 
m < 2n - 1 it diverges. Hence, in this situation, for m < 2n - 1 the response 
of the system is always enhanced when the noise level is increased. Thus, 
noise is unable to destroy the coherent response of the system to the periodic 
input signal. 
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5 Discrete Symmetries 

So far, we have considered the invariance of the system under a continuous 
scaling of the noise level. It is also possible that the system may remain 
invariant only for a discrete set of values of the noise level. 

In order to study this aspect explicitly, we now consider the following 
Langevin dynamics; 

^ = -G(a:,t)x + m , (26) 

at 

where G{x,t) is a given function. Here, the input signal enters the system 
through G{x,t), and we will assume it to be periodic in time with frequency 
o;o/27r. The output of the system is given by v{x) = |a;|", with n a positive 
constant. 

The transformations 



X — 1 a;' = e^x , 

D-^D' = , (27) 

with 7 a constant, leave Eq. (26) and the SNR [Eq. (4)] invariant provided 
that 

G{x,t) = G{xe'>,t) . (28) 

Consequently, for the class of systems in which Eq. (28) holds, the value of the 
SNR at D is the same as at This fact occurs when G{x,t) = g[ln(x),t], 
where 5 is a periodic function of its first argument, with periodicity 7 if 7 
is the lower positive number satisfying Eq. (28). Therefore, the SNR is a 
periodic function of the logarithm of the noise level. Both signal and noise, 
however, are not invariant under this transformation, but change as 

S' = , 

Q' = . (29) 



In order to be more explicit, we consider the case in which 

G(x,f) = 0T[ln(x^)][l + acos(wot)] , (30) 



where a and ojq are constants, and 0t{s) is a square wave of period T, defined 
by 



0t{s) 



Ki if sin(27rs/T) > 0 , 
K 2 if sin(27Ts/T) < 0 , 



(31) 



with Ki and K 2 constants. 

Since the SNR has dimensions of the inverse of time, its behavior is closely 
related to the characteristic temporal scales of the system. Thus, variations 
of the relaxation time manifest in the SNR. When T is sufficiently large, for 
some values of the noise level the system may be approximated by 



— = -Ki[l + a sin(woi)]a; + C(t) , 
at 



( 32 ) 
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where i = 1,2, depending on the noise level. In such a situation the SNR is 
given by 

SNR = f{a,u>oK^^)Ki , (33) 

with / a dimensionless function. For a sufficiently low frequency, the SNR is 
proportional to Kj [SNR = /(o!,0)/tj], i.e. proportional to the inverse of the 
relaxation time. Consequently, there are two set of values of D for which the 
SNR differs in approximately ki/k 2 - In this case, multiple maxima in the 
SNR appear as a consequence of the form in which the relaxation time of 
the system changes with the noise level. The appearance of multiple maxima 
then implies the presence of stochastic multiresonance [19]. 



6 Conclusions 

We have shown how scaling arguments can easily be applied to derive the 
main characteristics of a broad variety of periodically modulated noisy sys- 
tems. Scaling of the noise level shows that the signal-to-noise ratio may in- 
crease when the noise level is increased, making the presence of stochastic 
resonance manifest. Thereby, under some circumstances, the constructive role 
played by noise is merely a consequence of the form in which the system scales 
upon variations of the noise level and may arise directly from dimensional 
analysis. The methodology we have outlined is not restricted only to the sys- 
tems we have explicitly considered here, but can be applied also to a much 
broader variety of situations due to the generality of the assumptions involved 
in the scaling arguments. 
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Abstract. Underdamped bistable dynamical systems driven by both periodic and 
noisy forces show the typical phenomenon of Stochastic Resonance. Such a phe- 
nomenon, characterized by the increase in the periodic component of the system 
response as a function of the noise intensity, can be ascribed to two different mech- 
anisms which, under certain condition, can coexist resulting in a characteristic 
double maximum in the power spectral amplitude. The locations of these maxima 
correspond to matchings of deterministic and stochastic time-scales in the system 
thus supporting the use of the term resonances. 



1 Introduction 



Stochastic Resonance (SR)[1] is a noise-induced cooperative phenomenon, 
manifest in bistable systems, wherein the periodic character of the system 
response to a small time-periodic force can be maximized in the presence of 
an optimal amount of noise. Initially proposed [2] as a possible explanation 
for the periodicity of the ice ages, SR has been studied in a variety of non- 
linear dynamic models, and experimentally observed in a number of physical 
systems (see e.g. [1]), including lasers[3], EPR spectrometers[4], SQUIDs[5], 
various electronic and magnetic devices [6], and neurophysiology [7]. 

The theoretical study of the complete inertial dynamics for these systems 
is a difficult task, due to the intrinsic complexity of the nonlinear dynam- 
ics in the presence of deterministic (periodic driving) and stochastic (noise) 
forces. However, using analog simulations, we can show that in this case a 
resonant phenomenon (called intra-well SR) appears, for a range of parame- 
ters, in addition to the classical (i.e. inter-well) SR. A form of intra-well SR 
in monostable systems (specifically, the underdamped single-well Duffing os- 
cillator) was first reported in [8], while “conventional” SR in bistable system 
with finite damping was first addressed in [9]. In this letter we show, for the 
first time, the coexistence/competition between these effects, over a certain 
range of system and forcing parameters, in an underdamped bistable system. 
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2 The Model 

We consider the Brownian motion of a point particle of unit mass in a bistable 
potential V{x), subjected to a time-periodic force A{t) = Aq cos f2t and ex- 
ternal noise ^(t), described by the following Langevin equation[l] (the overdot 
denotes time-differentiation) : 



X = —jx — - — I- Aocosl?t -I- ^(t). (1) 

ox 

Here, ^(t) denotes an exponentially correlated Gaussian noise with zero 
mean and autocorrelation < C(^)4(0) >= exp(— |t|/rc), Tc and a being the 
noise correlation time and standard deviation, respectively (in the following 
we use of the noise intensity D which is related to a and t hy D = Tco'^). 
V{x) = — aa;^/2 + 6x^/4 is the standard quartic bistable potential (a, 6 > 0) 
having minima at ia;™ = ±V^o/6, and separated by the potential barrier 
AV = jAh. 7 > 0 is the viscous damping constant. SR in (1) was discussed 
in ref. [9, 10]. Since then, only a few papers [11, 12] have addressed the study 
of SR in the underdamped bistable case, an important exception being the 
study of SR in quantum systems [13]. 

The dynamics (1) have been studied here via analog simulation (see Gam- 
maitoni et. al.[l], p. 252, for details on the electronic simulator). In fig. 1 we 
show the amplitude of the power spectral density 5(1?) of the system re- 
sponse x{t) at the forcing frequency /?, as a function of the noise intensity. 
For certain range of frequency values, a double resonant peak structure is 
evident: the peak at higher noise can be interpreted (see below) as the usual 
SR p.eak, due to the synchronization of the jumps between the potential wells 
with the external forcing, while the peak, at smaller noise intensity values, 
is due to an intra-well resonance characterized by the matching of the exter- 
nal forcing frequency J? with the (noise-dependent) characteristic frequency 
of the nonlinear oscillations in a single well of the potential. When a single 
peak occurs (see e.g. the 2.20 kHz curve), hopping dominates the dynamics. 
Clearly, both resonances co-exist (at different noise intensities) over only a 
narrow range of the drive frequency f?, for a certain choice of system param- 
eters. A plot (fig. 2) of the spectral amplitude 5(f?) vs. the noise intensity 
for different damping parameters, elucidates some of the phenomena alluded 
to above; most importantly, we observe that the double-resonance appears to 
occnr only for damping parameters and signal frequencies in a certain range. 

A phenomenological description of the behavior detailed in figs. 1 and 2 
can be provided. At extremely low damping (see fig. 2), even a small (broad- 
band)perturbation can lead to noise-assisted hopping; the inter-well motion 
clearly dominates the dynamics also at small noise intensity and the syn- 
chronization of the hopping rate to (one-half) the external signal frequency 
characterizes the (single) peak in the spectral amplitude, thus resulting in 
the (conventional) SR phenomenon. With increased damping, one observes 
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Fig. 1. Power spectral density amplitude S{uj) (a.u.) of the system response x{t), 
at the forcing frequency w = 12, as a function of the noise standard deviation a 
(a.u.), for various values of j/ = f2/2it (in kHz in the figure). The characteristic 
frequency i'o{D) = uio{D)/2n in the absence of noise is r'o(O) = 6.00 ± 0.15 kHz. 
Other parameters values AoXml^V = 0.452, 7 = 0.47, Tc = 4.5 ± 0.2^s. Inset: cor- 
responding curves (from above 5.50 kHz, 5. 00 kHz, 4.50 kHz and 3.75 kHz) plotted 
versus D = DI{‘^AV) 



two peaks in 5(J?) but only when the forcing frequency takes values around 
the unperturbed characteristic frequency at the bottom of the wells. In this 
case, the motion is a combination of inter-well hopping and small oscillations 
in the bottom of the wells. The latter motion dominates for low noise and is 
approximately harmonic: the system response amplitude changes as a func- 
tion of the forcing frequency 1?, following the forced harmonic oscillator law. 
When the noise intensity is increased, for a fixed value of /?, the system mo- 
tion becomes more complex with nonlinear features (specifically, the profile 
of the single well) coming into play. For such a nonlinear oscillator we can de- 
fine an characteristic frequency, u>o{D), which is a function of the amplitude 
of the motion and, thus, of the noise intensity D = TcCt^; the low-noise peak 
corresponds to /? ss uio{D). As the noise increases even further, the hopping 
motion begins to dominate, and one recovers the usual (single-peaked) SR 
behavior. 

In the absence of the signal, the Kramers rate or one of its generalizations 
[14] for low friction may be used to characterize the inter-well hopping. While 
such a characterization forms the cornerstone of theoretical descriptions of 
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Fig. 2. S{n) (a.u.) vs. a (a.u.) as in fig. 1, for various damping parameters, i/ = 3.75 
kHz Other parameters as in fig. 1. 



SR under adiabatic conditions (periodic forcing with frequency much lower 
than the system characteristic frequencies), it fails to describe the dynamics 
in the presence of non-adiabatic conditions (i.e. high frequency forcing like 
in the Q = 3.75 kHz case of fig. 2, to be compared to the 6.00 kHz of the 
unperturbed system characteristic frequency) which generate the lower-noise 
maximum in the spectral amplitude, when the double maximum exists. Hence 
a simple adiabatic theory [1] cannot be applied to the system in this case. 
The breakdown of the adiabatic conditions is also responsible for the absence 
of the well-known [14] crossover (as 7 increases from 0) in the Kramers rate 
in the curves of fig. 2 for fixed values of noise in the inter-well SR regime 
(compare with the low frequency curves in fig. 6 of [10]). 

We now compute, approximately, the noise dependent characteristic fre- 
quency uJo{D) and investigate the approximate matching H « uJo{D) (see 
below). First we note that the characteristic frequency for the deterministic 
nonlinear oscillator with energy E can be estimated by computing the inverse 
of twice the deterministic transit time [15] from one extremum of the oscilla- 
tion interval to the other, within the srune well. Denoting these extrema (for 
the right well) by x± (r_ < a;+), we have for twice the transit time, 

/■*+ dx 

T{E) = 2 , 

^2{E-V{x))’ 



( 2 ) 
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with the extrema computed via the intersection E = V{x) in the right well: 



x±{E) = 



a 

b 





(3) 



After some computation, we obtain T[E) in terms of the complete elliptic 
integral of the first kind /C(II) [16]: 



T{E) = — 
x+ 




(4) 



where we set q = (a;^ — a;i)^/^/rr+. 

In the presence of noise, we replace E by E, the average energy. To com- 
pute E we note that for weak damping and low noise, the energy is ap- 
proximately a constant of motion. Writing the dynamics (1) in terms of the 
position and energy variables (x,E), we may write down a 2D Fokker Planck 
equation (FPE) for the time evolution of the joint probability density func- 
tion W{x,E,t), whence the a;-variable may be integrated out [17] leaving us 
with a ID FPE for W{E,t), the energy density function: 



dt 



W(E,t) 



= l{ 



d [0(E) 



D 

7J 



+ D 



dE [0'(E) 

^{mw(E t)l 
dE^ \0'(E) ^ ’ V 



W[E,t) 



(5) 



with the identifications, 



^{E) = f ^ - V{x)dx 

J X- 
1 



dx 



VE-vixy 



( 6 ) 



where we have taken the noise to be gaussian delta-correlated having zero 
mean and correlation function < >= 2DS{t — t') (the Tc — > 0 limit 

of the correlated noise defined earlier). Equation (5) has the steady state 
solution, 



W(E) = N 



-1 

0'(E) 



exp 






(t>{z) 



dz 



(7) 



with N a normalization constant, and 0(E), 0'(E) expressed in terms of the 
complete elliptic integrals of the first /C(II) and second kind 5(11) [16]: 
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ffi) = 3 

4AV (l + ^Jl + ^) 

^ m 

^{q) “ (l + + 'Bt) ^(3) 



( 8 ) 



From the energy probability density function W{E) we compute, numer- 
ically, the average energy as a function of the noise intensity E{D), which is 
then substituted into (4) to compute the characteristic frequency ujo{D) 



O'jr 

-0(D) = ^ (9) 

The above calculation has been carried out for white noise and in the 
absence of the periodic forcing. To take into account the additional energy 
contribution coming from the periodic forcing we added the energy due to 
the forcing itself by approximating the system response (at resonance) to 
the periodic signal, by that of a harmonic oscillator of natural frequency 
oJo{D). For the small amplitude value of the forcing used here, the additional 
contribution turns out to be smaller than 5% of the unperturbed mean energy 
E. The white noise approximation is justified here by the choice of a simulated 
noise bandwidth larger than any other intrinsic frequency (> 35 kHz). 



3 Comparison with Experimental Results 

To compare our theoretical prediction for ujo{D) with experimental results, 
we plot the analog-simulated spectral amplitude curves of fig. 1 as a func- 
tion of the frequency, for various noise intensities (fig. 3) and determine the 
characteristic frequency values at the maxima of the resonant curves. These 
eigenfrequencies are then plotted against the theoretical prediction in the 
inset of fig. 3; the agreement, in the low-noise regime and for the weak sig- 
nal amplitude considered here is remarkable. The shift of the characteristic 
frequency to lower values with increasing noise intensity is apparent and is 
well reproduced by the theoretical prediction (continuous line). On compar- 
ing the values of the frequencies for which we have the presence of the first 
peak with theoretical predictions, it is apparent that the strenght of the peak 
is greater when the matching condition is more closely verified. For example 
for If = 5.50 kHz the peak is near its maximum (inset in fig. 1) and the posi- 
tion is located at D = 0.075 ± 0.020 {D = D/{jAV)) to be compared with a 
prediction of £• 0.085. On decreasing the frequency the position of the peak 

is moves toward higher noise values. This behaviour is affected by the low 
noise tail of the inter-well SR peak which tends to move toward lower noise 
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Fig. 3. Power spectral density S{w) (a.u.), as a function of the frequency, for various 
noise intensities: squcires D = 0.00, circles D = 0.04, up-triangles D = 0.13, down- 
triangles D = 0.20, diamond D = 0.32, (same data as in fig. 1). Inset: (data points) 
measured eigenfrequencies i^q{D) = ojo{D)/2tt as a function of the noise intensity, 
and (continuous line) theoretical prediction in eq. 9. 



values and, for low frequency values, dominates until the intra-well motion is 
not effective anymore. 

A large number of nonlinear dynamic systems and processes may be ap- 
proximated by underdamped dynamics of the form (1), albeit with different 
forms of the potential energy function V{x). In this work we discussed the 
appearance of an additional resonance due to the intrawell oscillator dynam- 
ics and its relationship with the damping. A more detailed description of 
damping and noise color effects will appear in a future publication. 
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Abstract. A system of three stochastic two-state resonators driven by a harmonic 
signal is studied. Especially, we focus on the influence of an asymmetry of the 
resonator on the response of the system. Both systems of symmetric and asym- 
metric resonators display a non monotonous dependence of the spectral output on 
the coupling strength. While the amplification of the signal for symmetric coupled 
resonators is optimized for positive coupling (attractive interaction), in the strong 
asymmetric case the optimal output is found for negative coupling (repelling inter- 
action) due to a symmetrization of the system by the coupling. 



1 Introduction 

The detection of a weak signal by a nonlinear resonator can be improved by an 
appropriate level of noise. This is the essential point of stochastic resonance 
(SR) [for extensive reviews, see [1] and [2]]. Consider a bistable resonator 
driven by noise and a weak harmonic signal, for instance the overdamped 
Brownian motion in a double well potential. In that case, the power spectral 
density of the system consists of a typical noisy background and peaks at the 
driving frequency and its higher harmonics. The height of the first peak scaled 
with the signal intensity is called the spectral power amplification (SPA) and 
passes through a maximum as a function of noise intensity. The ratio of the 
peak height to the noisy background, the signal-to-noise ratio (SNR) exhibits 
the same feature which is a manifestation of the SR effect. 

In recent years it was shown that SR can be significantly enlarged in an 
array of coupled stochastic resonators instead of just a single element. For this 
array enhanced stochastic resonance the coupling strength turned out to be a 
second design parameter with regard to the purpose of signal detection. This 
has been demonstrated with numerical simulations [3] as well as analytical 
studies [4] [5]. 

The analytical problem of calculating the SPA and SNR, became tractable 
in [4] and [5] by two simplifications: 1) a reduction of the (generally contin- 
uous) bistable dynamics of the single resonator to a two-state model and 
2) the assumption of a spin like nearest neighbor interaction between these 
two-state resonators. The first approximation was originally worked out in 
an early theory of SR [6] , while the second assumption permitted the use of 
Glauber’s theory for the stochastic Ising model of a spin chain. The analytical 
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results for an infinite number of resonators coupled to form a chain revealed 
indeed the aforementioned twofold resonance with respect to the noise and 
coupling strength. As an example for finite system, three coupled symmetric 
resonators were studied in [7] exhibiting the same effect. 

Of course, systems displaying SR are not necessarily symmetric. It might 
thus be justified to examine the influence of an asymmetry in the transition 
rates of a chain of coupled two-state resonators. In this lecture, we will study 
such a system. For simplicity, we restrict our consideration to the case of 
three identical elements driven by the same harmonic signal. We will focus 
on the spectral power amplification as a measure for stochastic resonance. 

In the following section, we shall motivate the transition rates of the model 
in detail and explain how to obtain the SPA of a single coupled resonator 
from the master equation of the system. The analytical result for the spectral 
power amplification will be compared to numerical simulations. Furthermore, 
differences with the case of symmetric elements will be discussed. 



2 The Model 

The system we are going to investigate is illustrated in Fig.l. Each of the three 
resonators can be in one of two states cTj = ±1 with f = 1 , 2 , 3 corresponding 
to the minima of the double well potential. In the absence of the interaction, 
the transition rates are the same for all resonators but clearly asymmetric 
since the right well is deeper than the left one, i.e. the transition rate to the 
right will be generally larger than that to the left. In the absence of coupling 
and .signal these rates are given by a Kramers law [ 8 ] 

= -1) ~ I = ^expi-{AU - B)/D) 

W°{ai = + 1 ) ~ ^ ^ exp(-(Z\t/ + B)/D) (1) 

for transitions from left to right and vice versa, respectively. AU ±B denotes 
the respective potential barrier with B as the asymmetry parameter, D stands 
for the noise strength and the constants aoi/So are set to unity for the sake 
of simplicity. Throughout this work we set the potential barrier to AU — 
0.25. The nearest neighbor coupling adopted from [4] [5] [9] for a system of 

3 elements means that every resonator is coupled to every other one. The 
transition probabilities can generally be written as 

{(Ti) = Q (a -I- /?) -I- (/3 - a) j (^1 - (aj+i + cTi_i)) (2) 

A positive coupling strength 7 implies an attractive interaction, the res- 
onators are forced to align in the same well. In analogy to a spin system 
this case is often referred to as ferromagnetic coupling. For the particular 
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Fig. 1. Three coupled resonators (filled circles) are subject to identical asymmetric 
double well potentials, to white noise and to an external signal. The states —1 and 
+1 correspond to the left and right well, respectively. 



configuration depicted in Fig. 1, this would mean that the lower right res- 
onator being in state u = — 1 experiences an attraction towards the other 
state. In contrast, no force is obviously exerted on the other resonators be- 
cause the interactions of neighboring elements compensate each other. For a 
negative (anti ferromagnetic) coupling (7 < 0) the resonators are driven into 
an anti parallel alignment. In that case, the lower right element in Fig. 1 has 
a tendency to remain in <r = — 1 longer than in the absence of coupling. 

Assuming detailed balance for the rates (2) the parameter 7 is connected 
to the noise strength and to an independent parameter J [4] [5] [9] henceforth 
referred to as coupling strength 

7 = tanh . (3) 

Note, that the value of 7 is limited to the range [-1, 1] and its sign coincides 
with that of J. 

An additive weak and sufficiently slow signal modulates the potential 
barriers, suppressing or enhancing the transitions dependent on the state 
which is currently occupied. Thus, the Kramers rates become a function of 
time [6]. An expansion in leading order of the signal amplitude A then yields 
the time dependent transition rates 

Wi (ai) = W° (a,) ^ cos(m+4’) ^ ^0 cos (Ht + . (4) 

with f2 standing for the signal frequency and <p the initial phase of the signal. 

The master equation of the system reads 

3 

P(cr) = '£(Fi-l)Wi(ai)P(a) 
i=l 



( 5 ) 
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with the operators Fi defined by 

Fif (f^i) = f (6) 

for i = 1, 2, 3 and the rates Wi (ai) given by (4). 

Although the single resonator is asymmetric this asymmetry is the same 
for all resonators. Since we are only interested in long time properties of 
the system we can utilize the translational invariance of it, i.e. if the initial 
conditions are forgotten all resonators obey the same dynamics. 

In order to obtain the SPA ij it is necessary to calculate the time depen- 
dent mean value of the single resonator[10] [4] [5]. In principle it is possible 
to obtain this time dependent mean value by direct solution of the equation 
(5). This can be done by rewriting the master equation as a set of eight (lin- 
ear and time dependent) differential equations corresponding to the possible 
states of the three resonators. 

Another way which strictly follows Glauber’s work is to obtain directly 
from (5) the equation for the time dependent equal time correlators. Using 
this method together with the assumption of the translational invariance the 
whole problem is to a large extent simplified. For the first three asymptotic 
equal time correlators we use in the following the abbreviations 

s(t) = ri(t) = (ak(t)ak±i(t)}, c(t) = {ai(t)cr2(t)a3(t)). (7) 

Here, we have utilized the translational invariance resulting in the inde- 
pendence of the first equal time correlator on the position in the ring and the 
dependence of the second on the distance between the resonators only. 

3 Symmetric Case 

This case was already studied in [7]. Here, the asymmetry parameter B in 
(1) is equal to zero and the transition rates are given by 

IPj (o"i) = -a ^1 — ^(Ti ((Tj+i -I- ~ 

By multiplying of Eq.(5) times ai, aiGk, aiakai and averaging over the 
ensemble one obtains the following correlator equations [4] [5] [9] 

— = -a (1 - 7) s{t) + (1 - 7ri)cos(J?t -|- 

dri ^ 

— = -a ( 2 - 7) n(t) -I- 07 4- a— [(2 - 'y)s{t) - 7c(t)] cos(f?t -f <p) 

Idc A 

3^ = -o:c(t) -I- a‘js{t) + a— (1 -7)ri(t)cos(I?t -t- 0). (9) 

These equations can be solved in linear response theory (A D) by making 
the following Ansatz 

s = So-f-Asi, n =rio 4- Aril, c = co4-Aci. (10) 
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where the expressions with subscript 0 denote the unperturbed solutions 
(A=0). The long time limit of the solution for the mean value of the single 
resonator reads 

s{t) = q cos (fU + (f> + 9) ( 11 ) 



where amplitude q and phase shift 9 are given by 



Q = 



D 



q(1 - 7 ) 



2 + 7 1 

{I- jf’ 



tan^ = 



-n 

a(l - 7 )' 



( 12 ) 



After averaging over the uniformly distributed initial phase cj), the SPA rj 
is obtained as 






^ 2 + 7 

.2-77 (a(l-7))^ + f?2' 



(13) 



In Fig. 2 the SPA is presented for different values of the (positive) cou- 
pling strength J and two different frequencies. The signal amplification curve 
possesses maxima both with respect to the noise intensity and the coupling 
constant J. As already reported in [7], this non monotonous dependence on 
the coupling vanishes for negative J. FVom Fig. 2 it can be seen that the noise 
intensity maximizing SPA Dmax shifts with increasing coupling to larger val- 
ues. 





Fig. 2. SPA versus noise intensity in the system of the three coupled symmetric 
resonators for different coupling constant and values oi Q = 0.05 (left panel) and 
Q = 0.2 (right panel). 



In order to find the conditions for the global maximum of the SPA with 
respect to the coupling and noise strength, the partial derivatives of the 
SPA with respect to J and D can be calculated. This yields the following 
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conditions 

2_ (32z^[/^ + 28AUD 4- 13£>^) - 7max + 16DAU + 7£>^) 

(14) 

and 

7max = ^ (4lf/ - y/MP+W^^DAu) . (15) 

By evaluation of (14) and (15) it can be confirmed that an overall maximum 
with respect to D and J can occur for a positive coupling strength J only as 
already mentioned above. 

The static response of the system i.e. the amplification for 1? = 0 reads 



V 



static 

s 



1 




(16) 



For all values of the coupling constant J the static response diverges with 
decreasing noise intensity. The SPA for a finite frequency can be recast into 

(u) 



where d = dynamical factor which causes the decrease of the 

SPA for small noise intensities [4]. For large noise intensity since d <§: 1 the 
behavior of the SPA is determined by the static response. Contrary, for small 
noise intensity d 3> 1 i.e. 



Vs 



static 



d?' 



(18) 



This yields the matching condition for the value of the noise which maximizes 
the SPA 



Q K, a{D 

max ) (1 ^{J,Dmax)) 



(19) 



1 - f?exp (20) 

For a given frequency fl the latter formula allows the conclusion that J is a 
monotonously increasing function of Dmax and vice versa. 

The physical mechanism of the enhancement of the amplification versus 
coupling constant can be understood as follows. For small coupling each res- 
onator is able to follow the signal independently. With increasing coupling 
the particles start to synchronize i.e. when two of them follow the exter- 
nal signal they can by the attractive force make the third particle behave 
in the same way. For increasing coupling constant a transition of the single 
resonator synchronized with the signal becomes a rare event. The possibility 
of simultaneous transition of all resonators is not taken into account by the 
Markov approach of the master equation (5). 



or 



Dr, 



-arctanh 
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4 Asymmetric Case 

In the asymmetric case {B > 0) the differential equations for the equal time 
correlators read 
ds 

2 ^ = -{a + /3)(1 - 'y)s{t) + {P-a) (r)n{t) - 1 ) 

+ ^[(^ - «) (1 - 7 ) s{t) ~{a + 0) (7n(t) - 1) j cos(J?t + 4>) 

2— = -(a + ^) ((2 - 7)n (t) - 7) + (,3 - a) (7c(t) - (2 - 7)s(t)) 

~ 7)s(*) - 7c(*)) + (,3 - a) ((2 - 7)ri(t) - 7) cos(l7t + (p) 

2 dc 

3 ^ = -(a + 3) (c(t) - 7s(*)) - (3 - a)(l - 'y)ri{t)'ys{t) 

+ ^ [(« + 3)(1 - 7)^i(0 + (3 - a) (c(t) - 7s(t)) cos(f?t + (/>). (21) 

Again, a linear Ansatz like in (10) can be made. Here, the problem of de- 
termining the oscillatory part of s{t) is much more complicated since af- 
ter the substitution of (10) into (21) the resulting equations are still cou- 
pled. Therefore, the formula for the SPA becomes rather lengthy and is not 
presented here. The final evaluation has been performed by means of a symbol 
manipulating computer program. 




Fig. 3. SPA versus noise intensity for B = 0.2 and two different values of the input 
frequency (2 = 0.05 (left panel) and J? = 0.2 (right panel). The analytical curves are 
compared to results of computer simulations of (5) at signal amplitude A — 0.05. 
Note that in the legends the absolute values of the (negative) coupling constant are 
given. 

Consider first the case of a strong asymmetry. In this case, no enhance- 
ment of the SPA with respect to the coupling is observed for positive values 
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of J contrary to the symmetric case. The effect occurs now for negative cou- 
pling as it is shown in Fig. 3 for two different driving frequencies. There exists 
a moderate coupling strength J for which the SPA attains a maximum the 
height of which is quite small compared to the symmetric case (cf. the scales 
in Figs. 2 and 3, respectively). Note that the maximum with respect to both 
coupling and noise strength appears at a fairly small noise strength, while for 
larger or smaller values of J the maximum with respect to D is observed at 
larger values of D. 

In order to verify these complicated features of the asymmetric system 
we have performed computer simulations of (5) . Using power spectra of a set 
of system trajectories (10^® time steps, amplitude A = 0.05) we estimated 
the SPA also shown in Fig. 3. The analytical curves and the simulation data 
agree rather well and thus reveal the validity of the linear response Ansatz 
and of our results. 

Consider the SPA for changing asymmetry depicted in Fig. 4 as a function 
of the noise intensity and the coupling constant. For each value of B there 
appears a global maximum which generally decreases and shifts to negative 
values of the coupling parameter J with increasing asymmetry B. For B fa 
0 (symmetric case) the global maximum of the SPA occurs at a positive 
coupling strength Jmax as discussed above. For moderate values of B « 0.1 
the maximum appears at Jmax = 0, in this case an improvement of the 
SPA by the coupling of the three resonators is obviously not possible. For 




Fig. 4. SPA as a function of the coupling constant J and noise intensity D for 
fixed frequency J? = 0.05 for three different values of the asymmetry parameter 
5 = 0,5 = 0.1 and 5 = 0.2 



large asymmetry 0.1 < 5 < AU the maximum is observed at a negative 
coupling constant Jmax < 0 as mentioned above. The mechanism of the 
enhancement differs essentially from that one in the symmetric case. In case 
of a large asymmetry a repelling coupling enables the system to operate in a 
symmetric way, i.e. the coupling removes effectively the asymmetry and the 
suppression of the response being characteristic for asymmetric systems [1]. 
We will explain this symmetrization now in detail. 
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For small coupling constant and small noise intensity all three resonators 
are in the deeper right well (see Fig. 1 ). This is the dominant state of the 
system. With growing repelling interaction, i.e. with increasing negative J 
another configuration becomes possible: one resonator being in the left well 
and two in the deeper right well. The rate for the transition to this config- 
uration is /3(1 -f I 7 D/ 2 , since there are three possibilities the total rate is 
multiplied by three. The rate for the inverse process is a(l - | 7 |)/ 2 , for a 
certain value of the coupling these two rates can be equal, i.e. the system is 
at least with regard to this two transitions symmetric. This corresponds to 

a(l-|7|)/2 = 3^(l + |7|)/2 

from which we obtain 

Of course, the two configurations are not the only ones, but are rather domi- 
nant as can be seen from the trajectories depicted in Fig. 5. In the beginning 



( 22 ) 

(23) 




<a>. 



n 



"v ✓"'N /'*N ✓■'"N ✓"n y 

Signal 



Fig. 5. Sample trajectory of the system for a parameter set according to the symme- 
try condition (23). Prom Top to bottom: trajectories of ci, 0 - 2 , < 73 , their average {cr}i 
and the signal (dashed line), (u); jumps between 1 and 1/3 and once in a while also 
to -1/3 correponding to a configuration with two resonators being in the left well. In 
order to illustrate the synchronization with respect to the signal a sufficiently large 
amplitude was used. Parameters: J = —0.07, B = 0.2, !7 = 0.05, A = 0.09, D = 0.1. 



all three resonators are in the right well (crj = 1 ), then the third resonator 
jumps to the left well {a\ = — 1 ), goes back to the right one, the first is 
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now jumping to the left and so on. The two configurations and the particular 
symmetry of the system can be readily seen by means of the “average” of the 
three resonators (cr)j = (cri + ct 2 + o'3)/3. Regardless of the specific resonator 
jumping to the left and back this quantity takes mostly the values (cr)j = 1 
(all in the right well) and {a)i = 1/3 (one in the left well) with almost equal 
probability. Once in a while there are also transitions to a configuration with 
two resonators in the left well ((cr), = —1/3) from which the system quickly 
gets back to {cr)i = 1/3. Apart from these rare events the average {a)i is 
symmetric and can follow the likewise symmetric signal cos(f7t + (j>) in an 
optimal way. The average of the single resonator is due to the translational 
invariance of the system equal to a third of (a-)i, hence in this case the SPA 
is approximately equal to that one of a symmetric system with rates (22) 
multiplied by a prefactor 1/9. We want to point out that this holds only true 
for values of D and J obeying (23). 

Using the formula for the symmetric single resonator with modified rates 
(22) and taking account of the prefactor 



^ 1 Ki-ItDP 

9 [c^(l _ I^Dp + 

we find for the maximal SPA the following condition 

^2_ [g(l-|7|)(/x + l)P 

^2(41^ - 1) + 2/x(^ - 1) + (^^ - 1) 



(24) 



(25) 



with ju = (1 - |7|)/(1 + |7l)- 

Eqs. (23) and (25) are approximative implicit conditions for the global 
maximum. For the set of parameters corresponding to Fig. 3 we find D = 
0.10922 , Q = 0.053 where we have used in fact a driving frequency of J? = 
0.05 and the global maximum appears at Dmax » 0.11. The small deviation 
in the frequency is due to the fact that the above argumentation holds true 
for small noise and hence for small driving frequencies only. For larger noise 
also transitions to the other states (two resonators in the left well) occur 
more often and have to be taken into account. These transitions result in a 
slightly larger SPA than expected by the approximation (24). The reason for 
this deviation is that more than one resonator can follow the signal within 
one period. 



5 Summary 

We have investigated a periodically modulated system of three coupled res- 
onators by means of the spectral output of a single resonator and have shown 
that either a system of symmetric as well as asymmetric resonators can ex- 
hibit an enhancement of the output by tuning the coupling strength. While in 
the symmetric system this non monotonous dependence of the SPA turned 
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out to be due to a cooperative effect between the three resonators, in the 
asymmetric case a completely different mechanism applies. We could demon- 
strate that in this case the asymmetry of the system can be effectively re- 
moved by an appropriate repelling coupling. The analytical results were found 
to be in good agreement with numerical simulations of the full system. 
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Abstract. In this article, the role of internal noise in some recently proposed neural 
encoding mechanisms is investigated in a simple network of threshold devices. By 
allowing each threshold in the network to be independently adjustable, a method 
of optimising the transmitted information through the network is developed. The 
performance of this ‘optimally matched’ network is then compared to networks 
that display noise-enhanced information gains. A number of interesting conclusions, 
regarding the signal processing capabilites of these networks and the role of internal 
noise are reached. The implications of these results for neural encoding mechanisms, 
are discussed. 



1 Introduction 

Recent experimental and theoretical studies have demonstrated that noise 
can take on a positive functional role in a variety of biological systems [1- 
3]. Of particular interest, is the proposal that, through the mechanism of 
stochastic resonance[4] (SR), internal neuronal noise could aid in the opti- 
misation of the response of sensory neurons to a weak subthreshold stimulus. 
This beneficial role, mediated by the SR effect, holds provided that, in the 
absence of any noise sources, the signal is sufficiently weak so as not to cause 
any neuronal response by itself i.e. it is subthreshold. If the signal strength 
is increased to suprathreshold levels then SR effects are not generally ob- 
served [3,5] (although for marginally suprathreshold signal levels SR effects 
can still persist [6]) and, consequently, noise has only a detrimental effect on 
the encoding process. This ‘SR coding strategy’, where noise can play both 
a negative and positive role depending on the size of the signal, seems to ap- 
ply in situations where neurons are largely unable to modify their threshold 
levels (adapt) in response to changes in the input stimulus [5, 7]. 

However, it is known that many sensory neurons do have adaptive capabil- 
ities [8] . This has led to the proposal of an alternative coding strategy based 
on the principle of ‘optimal information flow’ [9]. The idea is that neurons 
adapt their thresholds in response to changes in the stimulus. This provides a 
mechanism for optimising information transmission to the processing centres 
of the brain. For this coding scheme, it has been demonstrated that noise 
always has a detrimental effect i.e. it does not help enhance information flow 
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[7]. This coding scheme is obviously at odds with the SR coding strategy and, 
consequently, the role of internal neuronal noise is still largely unclear. 

However, much of the above discussion (although not exclusively) is with 
regard to a single neuronal element. Recent studies have started to focus on 
parallel arrays of model neurons [2,10]. The motivation for this comes from 
the fact that sensory nerves have a highly parallel, multi-fibre structure. To 
date, these model networks (arrays) have been studied in the context of the 
SR coding strategy, where again it has been demonstrated that noise can have 
both a positive and negative effect. However, very recent results indicate that 
there is one significant difference between single and parallel multi-element 
networks. For an appropriate choice of threshold settings, SR effects can also 
be observed for arbitrarily large suprathreshold signal strengths [11]. As al- 
ready discussed, single elements cannot display SR at these signal strengths 
and hence this new form of SR was termed suprathreshold stochastic reso- 
nance (SSR).The implication of this result, at least for parallel networks, is 
that in principle internal noise can have a beneficial role regardless of signal 
strength. This suggests that, in addition to the two coding strategies dis- 
cussed, a third possibility exists where neurons use the SSR effect to enhance 
information flow. 

In this article, these coding mechanisms, and in particular the ‘optimal 
information’ principle and SSR schemes, are investigated in a simple parallel 
network of threshold devices. By letting the threshold levels be fully adapt- 
able, methods of optimising the transmitted information are developed and 
compared with noise optimisation via SSR. As we will see, SSR seems to offer 
a compromise between the SR and optimal information coding strategies. 

2 The Network 

A summing network of N threshold devices (Fig. 1) is considered. Each 
threshold device is subject to the same input signal x{t) but independent 
Gaussian noise, with a standard deviation, cr,,. The devices are mod- 

elled as Heaviside functions, the outputs, yi{t), being given by the response 
function. 



r 1 if x{t) -I- T}i{t) > 9i 
\ 0 otherwise 



( 1 ) 



where 6i are the threshold levels and i = 1,2,. ..N. The response of the 
network is obtained by summing the individual responses of each device. 
Consequently, y{t) represents the number of devices that are triggered at any 
instant of time. 

This network is simpler in design than those previously studied, in that 
it comprises of simple non-dynamical threshold elements rather than more 
realistic neuron models such as the Fitzhugh-Nagumo (FHN) model. For this 
reaison, it lacks some of the realism captured by other networks. However, the 
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Fig. 1. A summing network of N threshold devices. Each device is subject to the 
same signal 



statistics, and hence dynamics, of these type of networks are largely governed 
by the timing of the ‘firing’ events and not precisely on the prescribed nature 
of the event (e.g. shape of response). Consequently, one could reasonably 
expect similar qualitative behaviour between different network designed using 
different neuron elements. 

The motivation for studying such a simple network is twofold: first, it 
helps to mitigate the increase in complexity caused by allowing each thresh- 
old to be independently adjustable - thus yielding the system more amenable 
to theoretical analysis; and, second, it enables contact to be made with tradi- 
tional signal processing systems and techniques. For example. Flash analogue- 
digital converters (ADCs) are implemented using such network using a uni- 
form quantization scheme. This is achieved by spreading the thresholds evenly 
across the signal space. However, as will be discussed below, companding 
(nonlinear compression and expanding) methods can be used to obtain non- 
uniform quantization schemes that optimally encode non-uniform signal dis- 
tributions. 

3 Transmitted (Mutual) Information 

An information theoretic measure - the average mutual information - will be 
used to quantify the amount of information transmitted through the network. 
The average mutual (or transmitted) information, I, for the network shown 
in Fig. 1 (which in information theory is regarded as a semi-continuous 
channel) can be written[12] 



N 



I = H{y)~ H{y\x) = Py{n) loga Py{n) 

n=0 



n=0 
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H{y) is the information content (or entropy) of y{t) and H{y\x) can be inter- 
preted as the amount of encoded information lost in the transmission of the 
signal. Py{n) is the probability of the output y{t) being numerically equal to n 
and P{n\x) is the conditional probability density of the output being in state 
n given knowledge of the signal value, x. The logarithms are taken to base 2 so 
I is measured in bits. If all information is lost in transmission H{y\x) = H{y) 
(which occurs as cr,, — l oo) and hence 1 = 0. Alternatively, if all encoded in- 
formation is transmitted (cr,, = 0) H{y\x) = 0 and I = H{y). Given it is 
straightforward to show[12] that for any non zero H{y\x) < H{y), it 
would seem to follow that maximum information transfer occurs when there 
is no internal noise. However, this is not necessarily the case, because internal 
noise also serves to increase H{y). Consequently, the maximisation of I by 
internal noise is a balance between additional information generated by the 
noise and the increased loss in information transmitted through the network 
with increasing cr,,. It is this ability of noise to maximise the transmitted 
information that is termed SR. 

The transmitted information can be calculated exactly in the specific 
case when all the thresholds are set equal to the same value, 6. Although this 
solution does not take into account the possibility of independently adjusting 
each threshold and, hence, is not an optimal solution, it is sufficiently general 
to account for the SSR effect. Under this assumption, I is calculated to be. 



N 



I = -5^Py(n)log2P'(n) 

=0 

J' (^)(-fl|x ^^§2 -^llx -^|x ^^§2 -^0|x)^ ) (^) 



n=0 

- ( ~N 



/ oo 

dxPAx)P^^,P,^^- 

-oo 



N—n 



where Py{n) = P'{n), is the Binomial coefficient. The signal distri- 

bution is taken as Gaussian, Px{x) = (1/ exp(— a;^/2(7^), and Pi\x = 
l/2Erfc[(0 — x)/y^2a^], is the conditional probability of j/j = 1 for a given x 

(note all devices are identical) and similarly Fol* = is the probability 

of a zero given x. Erfc is the complimentary error function. The integrals and 
summation in Eqn. 3 can be evaluated numerically. 



4 Suprathreshold Stochastic Resonance (SSR) 

Figure 2 shows the results of a digital simulation of the network with 6 = 0 
(the mean of the signal) and various N. The solid lines were obtain from the 
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theory and are seen to be in good agreement with the simulation results. It is 
immediately observed that SR type behaviour (i.e. noise induced maximum) 
is manifest for all iV > 1. As AT increases, the maximum value attained 
by I also increases. This is the SSR effect. Unlike classical SR in a single 
device, SSR is at its most pronounced (maximum noise-induced information 
gain) when all the thresholds are set to coincide with DC-component of the 
signal. Under these conditions, the deterministic crossings of the thresholds 
are maximised - almost the exact opposite to the conditions under-which 
SR in a single device is observed. The fact that the signal is suprathreshold 
means that SSR can be observed with any magnitude of signal provided the 
thresholds are set to coincide with the signal’s DC-component. 




Fig. 2. Plot of transmitted information against cr = ai^jox for various N and till 
6i = 0. The data points are the results of a digital simulation of the network and 
the solid lines were obtained by numerically evaluating Eqn. 3 



The mechanism giving rise to SSR is quite different to that of classical 
SR. In the absence of noise, all devices switch in unison and consequently 
the network acts like a single bit ADC (/ = 1). The fact that all devices 
act identically in response to the signal implies that they also carry identical 
information about the signal. Consequently, there is no advantage in having 
more than a single device. Ideally, one would wish the devices to carry at 
least a degree of independent signal information. This degree of independence 
is facilitated by the addition of noise. At any instant of time, finite noise 
results in a distribution of thresholds that, in turn, leads to the signal being 
‘sampled’ at N randomly spaced points across the signal space. In effect, the 
noise allows additional bits of information (output states) of the system to 
be accessed, resulting in an increase in the output entropy H{y). Although, 
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the information content of each individual device is reduced because of the 
noise, the sum total from all the devices results in a net gain. 



5 Optimal Quantization 

In this section a method of optimising the network, namely the technique 
of ‘optimal quantization’, will be discussed. The reason for undertaking this 
optimisation, is to investigate whether the ’optimal information principle’ 
coding mechanism can indeed be reaUsed and to compare the information 
gains with those obtained using SSR. 

To optimally match the network, the set of threshold levels, {0j}, that 
maximises I must be obtained. This is the problem of “optimal quantization” 
and is a long standing problem in engineering[13]. Typically, one tries to select 
the set {0j} to minimise an error norm ||(?/(t) — a:(t))P||, p — 2 corresponds to 
the standard mean square error. Unless the original signal distribution is uni- 
form, this optimisation process leads to a non-uniform quantization scheme. 
Equivalently, the network can be optimised by introducing a nonlinear com- 
pression function that acts on the signal prior to digitisation using uniform 
quantization. The goal is then to obtain the optimal compression function 
using a similar error minimisation technique. This is the method of com- 
panding and is widely used in modern digital telephone systems. However, 
companding is equivalent to having a non-uniform threshold distribution and 
therefore these two optimisation techniques lead to the same solution. 

The solution of the optimal quantization problem is, in its full generality, 
not straightforward. Indeed, I am not aware of a solution to this problem 
when the thresholds are subject to internal noise - as is the case under study. 
However, if one uses an information-theoretic approach (rather than an error 
minimisation method) and neglects internal noise, the optimal threshold set, 
{0i}opt that maximises information transmission, can easily be obtained. In 
this case I will be maximised if H{y) is maximised and, furthermore, H{y) is 
maximised when all possible output states are equally probable (maximum 
entropy) [12]. This gives us a criteria for selecting the optimal threshold values. 
For N devices there exists N + 1 output states, if each state is equally prob- 
able, we must have Py{n) = 1/{N +1) for all n. Given that in the absence of 
noise the thresholds quantise the signal according to Py{n) = dxPx(x), 
it is a simple matter to numerically obtain the optimal set for a given Px{x). 
For an N level system, this discretization scheme always yields the theoreti- 
cal maximum information, I = log 2 (Ar + 1), for an arbitrary Px{x). It should 
be borne in mind, that this result only applies at zero noise levels. In prac- 
tice {Oi}opt, will change with noise intensity. Hence, the performance of a 
network that has been optimally matched at zero noise will only give an ap- 
proximation to the optimal information possible at non-zero noise intensities. 
Nevertheless, these results will act as a useful lower bound for comparative 
studies. 
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Fig. 3. Plot of treinsmitted information against a for various N and {^i} = 

The data points are results form the digital simulation and the solid lines are guides 
to the eye. The dashed line is for AT = 31 and all Oi = 0 



The effect of noise on /, when the thresholds are chosen optimally at 
zero noise, is demonstrated in Fig. 3 (solid lines). It can be seen that in this 
situation I decreases monotonically in all cases. Consequently, this leads to 
the interesting conclusion that, in general, SR type effects are only observed if 
the threshold levels are set non-optimally. This result was already known for 
a single device, but now we see it is also true of a multilevel system. It seems 
that noise always has a detrimented effect when the thresholds are adjusted 
to optimise the transmitted information. The occurrence of SR effects can 
therefore be understood as follows; for a multi-level system, setting all di =0 
(as in Fig. 2) is not the optimal configuration and hence SSR is observed. 
However, for a single device {N = 1), the optimal threshold level is = 0 
(as long as Px{x) = Px{—x)) and hence SSR cannot be observed and classical 
SR effects can only occur when 6 is set to a non-optimal value i.e. > ax- 

The interesting question is how does an optimally matched network per- 
form in comparison to one demonstrating SSR? To give an indication of this, 
the dashed line on Fig. 3 has been plotted. This line represents the case for 
N = 31 when all {6>i} = 0 i.e all thresholds set equal to the DC value of 
the signal. This line can be compared with the optimally matched case for 
the same value of N. It can immediately be seen, that at small noise in- 
tensities, the optimally matched network significantly outperforms the SSR 
results, but at larger noise intensities, (cr > 0.5), comparable performance is 
achieved. These results are found to hold independent of N and therefore sug- 
gest that, at larger noise intensities, little or no benefit is gained from using 
a distribution of threshold values to optimise the transmitted information. 
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From a purely signal processing point of view, the above results seem 
to suggest that optimal performance is obtained with no internal noise and, 
hence, when SR effects are not observed. Ideally, one would design the system 
to adapt the thresholds to changes in the signal distribution. However, this 
procedure has a fundamental flaw when the signal is non-stationary - a situa- 
tion one would typically encounter in practice. For non-stationaxy signals the 
signal distribution becomes time-dependent, Px{x) Px{x,t), and hence 
{Si\opt -> {0i{t)}opt- From the method of ‘optimal quantization’ we know 
that {Oi{t)}opt can only be obtained if we know the instantaneous signal dis- 
tribution Px{x,t) - this requires apriori knowledge of the signal. To obtain 
the optimal set of thresholds, the system would have to know the changes 
in the signal before they actually occurred. Obviously this is not possible. 
Nor is it a simple matter for the system to monitor the signal and construct 
its distribution. To accurately estimate {^i(t)}opt, the system would have to 
obtain an accurate estimate of the signal distribution down to a bin width 
oc 1/iV. Even if the system had time to achieve this, a fast and efficient 
method of calculating {Oi(t)}opt would also be required. Clearly, this prob- 
lem rapidly becomes intractable with increasing N. It seems reasonable to 
conclude, therefore that, for non-stationary signals, parallel networks cannot 
be optimally matched to their signal source. 

These considerations suggest that there could be a role for internal noise 
after all. If a network cannot perform optimally without noise, maybe the 
non-optimally matched system can improve its performance by using noise. 
Fig. 4, shows what happens if a sudden large increase in signal intensity occurs 
whilst the network is in its optimally matched configuration. In the absence 
of noise the information transmitted about the new signal would have been 
reduced to /(cr = 0) = l.lbits. However, if the noise intensity is scaled to 
the new signal amplitude then, through the mechanism of SSR, comparable 
information transmission is obtained in both cases. By simply rescaling the 
noise, the transmitted information can be kept at approximately the same 
value - largely independent of the signal distribution and its variance. If no 
noise is present, the ability of the network to follow sudden changes in the 
signal is severely compromised and, additionally, a sophisticated adaptive 
algorithm - capable of an iV-variable optimisation - would be required to 
re-optimise the network. These results do not conclusively demonstrate the 
benefit of internal noise, but they do at least offer a possible reason why one 
would choose to include it. 



6 Conclusion 

For the simple network under study a number of conclusions have been 
reached. First, for non-stationary signals, it is not possible to adjust the 
threshold levels to optimally match the network to the signal - even if the 
levels are fully adjustable. Second, for large internal noise intensities, little 
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Fig. 4. Plot of transmitted information against cr for AT = 16. Data points are 
results of the digital simulation. The circles correspond to the optimally matched 
state {6i} = {6i}opt- The crosses indicate what happens when a 40dB change in 
signal intensity occurs but the threshold levels are left in their original optimal 
configuration. The solid lines axe guides to the eye. 



or no benefit seems to be gained from attempting to optimally match the 
network, in this regime SSR offers comparable performance. Finally, internal 
noise may be useful when trying to maintain the transmitted information at 
a constant level. 

The network is simple in design compared to real biological sensory sys- 
tems. Nevertheless, as already discussed, qualitative similar results may be 
anticipated and, indeed, SSR has very recently been observed in an FHN 
model neuronal array [14]. It is therefore of some interest to discuss the im- 
plications of the results for the sensory encoding strategies outlined in the 
introduction. First, taking the ‘optimal information’ approach, most previ- 
ous studies have considered stationary signals and single neurons [9], where 
only a single threshold needs to be modified to achieve optimisation. In this 
situation, optimisation is feasible. However, given that sensory stimuli tend 
to be highly non-stationary, it seems reasonable to conclude that large ar- 
rays of neurons are unable to achieve global optimisation. Furthermore, it is 
a remarkable fact that sensory neurons only have an output signal-to-noise 
ratio of approximately unity [9j. For the simple threshold network studied, 
this corresponds to the case cr ~ 1. At this level of internal noise, the network 
is seen to achieve near optimal performance via SSR - no advantage could be 
found by redistributing the levels. This therefore tends to suggest that there 
is no need for the neurons to adapt to the statistical structure of the signal 
distribution. This does not mean that no adaptive capabilities are required. 
SSR is at its most pronounced when all the thresholds adapt to the DC- 
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component of the signal[ll]. Consequently, the neurons must follow changes 
in the DC-component to maintain the level of information transmitted. 

Therefore, the question of what is the most appropriate coding strategy 
is largely related to the degree of stationarity of the signal and the ability of 
the system to adapt its threshold levels. If the sensory neurons are strongly 
limited in their ability to adapt, then the traditional SR strategy discussed in 
the introduction seems be to more likely. However, this coding scheme gives 
the least efficient transfer of information. If DC-adaptability is possible, then 
SSR gives better performance and is comparable, at least at the noise levels 
relevant to neurophysiology, with optimal coding strategy. Finally, although 
(by definition), optimal coding strategies are the most efficient, it seems un- 
likely that they could be physically realised. In this sense SSR seems to offer 
a compromise; it only requires DC-adaptation, seems to be nearly optimal at 
the appropriate noise intensities, and suggests a positive functional role for 
neuronal noise at all signal intensities. 
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Abstract. We consider 8bit grey scale images as two-dimensional input signeds. 
After the addition of stochastic patterns the resultant grey value matrix is two-state 
filtered with a global threshold. Depending on the threshold value non-dynamical 
stochastic resonance (SR) or suprathreshold stochastic resonance (SSR) conditions 
can be set up. Both phenomena are quantified appropriately through the transin- 
formation and illustrated by application to a sample image. Key issue of our in- 
vestigation will be the idea that the signal reconstruction is enhanced by not using 
spatially uncorrelated noise patterns but stochastic patterns which reflect features 
of the input. We exemplify this notion by employing stochastic Swift-Hohenberg 
patterns for both the input signal and the additional noise fields. 

1 Stochastic Resonance with Two-Dimensional Signals 

The reconstruction of an input signal which largely falls below a detector 
threshold clearly will benefit from diminishing the distance between threshold 
and the signal median [1]. In doing so, there exist two alternative (mutually 
non-exclusive) options; 

• Applying a uniform shift (see left of Fig. 1) corresponds to globally low- 
ering the threshold and, hence, to adapting the detector’s sensitivity. 
Shifting the threshold down to the signal median equalizes the binary 
output histogram, thus, maximizing the output information (Shannon 
entropy). While this might be the method of choice for many technical 
applications, for biological sensors and sufficiently weak signals this sen- 
sitivity tuning must fail because of a sensor-specific principle restriction 
of the detection range. Moreover, as was already discussed by Stocks [2], 
when combining the output of many identical detectors the optimum so- 
lution deviates from simply summing the output of a single detector with 
optimally adapted threshold. 

• Even if a uniform lowering of the threshold is not feasible it is still natural 
to consider the effect of unbiased additive noise. The addition of noise to 
each pixel can be regarded as stochastically changing the local signal-to- 
threshold distance. As can be seen from Fig. 1 (right) fluctuations can 
change the noise-free output in a twofold way: Pixels being subthreshold 
prior to the addition of noise can become suprathreshold when a suffi- 
ciently large fluctuation is added (situation A). The converse situation 
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B of an originally suprathreshold pixel pushed below threshold by the 
addition of a suitable fluctuation is also possible, however, can occur 
less frequently due to the discrepancy between signal median and thresh- 
old. Noise-induced enhancement of signal detection, in our setup with 
a flxed threshold also called non-dynamical stochastic resonance [3,4], 
thus means stochastically lifting enough moderate-to-high but nonethe- 
less subthreshold pixels above threshold while leaving the majority of 
the moderate-to-low pixels below it. The beneflcial role of fluctuations, 
hence, rests on the mismatch between signal median and threshold. Con- 
sequently, it must vanish whenever this discrepancy looses signiflcance, 
either when shifting the threshold down to the signal median or when the 
intensity of noise exceeds the variance of the input signal by far. 





Fig. 1. To enhance the detection of a subthreshold signal one can either lower the 
threshold (left) or employ symmetric fluctuations to raise pixels above threshold 
(right): signal (solid), signal medicin (long dashed), threshold (dashed), arrows in- 
dicate the local change of the signal-to-threshold distance (further explanations see 
text). 

In the limit of extremely high noise intensity the output pattern will reflect 
characteristics of the stochastic source rather than features of the signal. For 
an unbiased white noise source the imbalance of the (binary) pixel histogram 
of the output in this limit will become minimal and, as a consequence, the 
output information will achieve its maximum. This observation clearly shows 
that the Shannon entropy does not measure the information about the input 
which is contained in the output. To assess the efficiency of signal detection 
one has to quantify the statistical correlation between the input signal X 
and the output pattern Y. An information theoretic measure which qualifies 
for this task is the so-called transinformation (mutual information) /[y|X] 
(cf. the preceeding article by Stocks in this issue) 



( 1 ) 
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where Xi = 0, 1,2, . . . , 255 and yj = 0,255 - anticipating 8bit grey value 
images as input and a binary (white (0) and black (255)) output image -, and 
p{xi), p{yj), and p(xi,yi) denote the single and joint grey value histograms 
respectively. As a Kullback information /[F|X] enjoys the properties of being 
non-negative (for any admissible joint histogram) and zero if and only if input 
and output are statistically independent, i.e. iff p{xi,yj) = p{xi)p{yj). 

The transinformation can be reformulated in the following way 

I[Y\X] = H[Y] - H[Y\X] (2) 

where H[Y] is the (Shannon) information of the output Y alone 

( 3 ) 

i 

and H[Y\X] the information of the output Y conditioned by the input X 

H[Y\X] = ^p(a:i)^^p(t/j|a;i)log2[p'‘^(2/i|2;i)]y ( 4 ) 

When the output is independent from the input = H[Y] and, as 

argued before, /[T|X] = 0. This occurs when the noise intensity gets so 
large that it completely randomizes the output and erodes any trace of the 
signal. In the other extreme, when Y is determined by X unambiguously, 
i.e. p{y\x) = S{y — f{x)), then H\Y\X\ = 0 and I\Y\X] = H\Y\. This sit- 
uation exactly occurs in the noise-free limit, viz y = 255 ©{x — b) where © 
is the Heaviside (step) function and b the threshold value. For completely 
subthreshold signals without noise all output pixels will be white, hence, 
/[yiX] = H[Y] will be zero. Together with the non-negative character of 
/[y|X] we conclude that in this case a maximum of the transinformation 
and, consequently, stochastic resonance (SR) is inevitable [5]. This conclusion 
also holds true for the complementary extreme that the signal is completely 
above threshold which means without noise all output pixels are black. 

The situation that only parts of the signal are subthreshold is not clear 
in advance since the increase of H\Y\X] with increasing noise might well 
be overcompensated by an increctse of H\Y]. At least the extreme case that 
the threshold coincides with the signal median is easy to decide. In this 
case without noise the transinformation achieves its maximum because, as 
mentioned before, the binary output histogram is equalized, i.e. p(whit=) = 
p(buck) = 0.5. Noise only acts to deteriorate this maximum information about 
the signal resulting in a decline of transinformation with increasing noise 
intensity (cf. Fig. 2 for W = 1 of Stocks’ contribution in this issue). This 
insight is rather disappointing for the “stochasticioner” who is in an eternal 
pursuit of constructive aspects of noise. However, going from single images 
to a collection of images immediately will make him smile again. The reason 
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is easy to see: If we superimpose many output images Fi , . . . , Yjv forming 
an average image the result is no longer a binary but again a grey level 
image. These new degrees of freedom, however, require noise to be activated: 
In the absence of noise the superposition of arbitrarily many output images 
will still be a black and white image since then the response to the signal is 
unique. ‘‘‘‘Grey beats black and whitd' - this is the essence of what was termed 
suprathreshold stochastic resonance (SSR) by Stocks [2]. 

It has to be mentioned that SSR is used as an acronym for the situation 
that half of the pixels are suprathreshold and not for the case that the first 
and largest pixel just gets suprathreshold. Thus, due to the complementary 
informational nature of totally white and totally black, SSR describes the 
opposite extreme of SR. 

For an illustration of these statements take a look at Fig. 2. 




Fig. 2. SR (upper row) and SSR (lower row) applied to a sample image (by courtesy 
of Lutz Schimansky-Geier); for explanations see text. 



The upper left image shows the input signal which is an 8bit grey value 
image. The information of this input was computed to H{X) = 7.32 bit; note 
that this necessarily must bound J(y|X) from above since H{X) — I{X\X), 
i.e. H{X) is the transinformation in case of perfect image reconstruction. 

The upper middle image displays a single output, i.e. iV = 1, for a thresh- 
old fixed as high as to make the input completely subthreshold and result- 
ing optimal noise; this example serves as an illustration for classical SR. Its 
transinformation is I{Y\X) — 0.12 bit. 
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The upper right image applies to the same threshold and noise intensity. 
It is the averaged output for an ensemble of size N = 256 with a transinfor- 
mation I{Y\X) = 2.28 bit. 

The lower left image exhibits the noise-free output with the threshold 
chosen such that I{Y\X) = H{Y) = 1 bit (maximum transinformation). 
Note that the result would not change when averaging over arbitrarily many 
realizations. 

The lower middle image depicts a single output, i.e. = 1, for the same 
SSR condition and a noise intensity chosen identical to the lower right image. 
Its transinformation I{Y\X) = 0.39 bit tells that the reconstruction is worse 
than for the noise-free case (lower left).^ 

The lower right image illustrates SSR: for an ensemble oiN = 256 the av- 
eraged output with transinformation I{Y\X) — 3.39 bit is much higher than 
the related value for the noise-free case - an assessment which undoubtfully 
meets the judgement of visual perception. 

2 Stochastic Resonance 

with Spatially Correlated Noise 

In the above illustration we have used the original grey value image as a 
complex input signal. In the framework of spatially extended systems each 
pixel can be identified with the site of a two-dimensional grid. For each specific 
site the considered ensemble of output pixels can be regarded as the output of 
an uncoupled detector array being fed with identical input. In the context of 
visual perception this ensemble can be understood as resulting from sampling 
a frozen (or adiabatically changing) image. The success of averaging can then 
be trivially explained by the law of Imge numbers. A more sophisticated 
approach would try to enhance the detection performance by optimizing a 
“coupling” of the ensemble members, e.g. by threshold quantization (cf. the 
proceeding article by Stocks in this issue). 

Instead of following this route, here we consider effects of spatial couplings 
which, on the one hand, are present in the input signal and which, on the other 
hand, can also be introduced between the detector units at different sites. 
The observation that signal detection and amplification can be improved by 
coupling many SR elements was termed array-enhanced stochastic resonance 
(AESR) [6]. There exists a variety of different coupling schemes, amongst 
which diffusive [6] or Glauber type [7] couplings are the most popular. In the 
present work we introduce a coupling via spatially correlated noise patterns. 
This touches upon the old question whether coloured noise can improve SR. 
The answer given in [8] is not unique: While for overdamped systems driven 
by periodic signals and coloured noise SR was suppressed the opposite was 
true for colour introduced by inertia or for asymmetric dichotomic noise. 

* Perhaps the reader will judge this differently, however, this impression has its 
roots in the smoothing ability of visual perception. 
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The key point of our analysis is the intuitive conjecture that SR and SSR 
might benefit from applying noise patterns whose spatial correlations are 
optimally adapted to the spatial correlations present in the complex input 
pattern. Being far from a thorough analysis of what might be called adaptive 
SR [9], we will solely exemplify our idea by choice of a specific input pattern 
which is nothing but one realization of the class of stochastic fields that we 
later on apply in the task of detection. Hence, by construction, input and 
added noise patterns will have extremely similar features. Eventually, we will 
compare this detection routine with related results achieved with spatially 
uncorrelated, i.e. white noise patterns. 



2.1 Generating Spatially Correlated Noise 



Stochastic fields with correlations ranging over some finite distance can be 
constructed by combining deterministic couplings with spatially white noise. 
In the temporal domain this method is known and applied since long, e.g. 
when using the Ornstein-Uhlenbeck process to generate an exponentially de- 
caying correlation function. A deterministic coupling is usually introduced 
through terms involving powers of the Laplace operator (or, for discrete 
systems, a suitable finite-difference approximation of it). The fact that we 
consider a two-dimensional field implies that the related field equation is 
a partial differential equation (PDE) in contrast to an ordinary differential 
equation (ODE) (with respect to time) shaping the deterministic part of the 
Ornstein-Uhlenbeck process. In discrete systems the partial differential equa- 
tion transforms into a (perhaps huge) set of coupled ODEs. A discrete Fourier 
transform is apt to decouple this system of ODEs. Prom a formal integration 
in Fourier space and the white character of the additive noise component an 
algorithm can be constructed [10] which proceeds 



1. by choosing zero mean Gaussian random numbers with a correlation 
function 



- in connection with symmetries to be obeyed in order to generate a real 
field -, 

2. by Fourier filtering 



— 






T Cu 



( 6 ) 



- where e and t axe the white noise intensity and some correlation time 
(rooted in the dynamical field equation). Lx and Ly denote the linear ex- 
tensions measured in the common unit zi, and the quantity Cy,v is nothing 
but the Fourier transform of the linear(ized) deterministic operator oc- 
curring in the discretized field equation, i.e. the Fourier transformed field 
equation can be written as 






( 7 ) 
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- and, 

3. by finally performing the inverse Fourier transform . 

Starting, for instance, from the linear reaction-diffusion equation (RDE) 

T dt^{r,t) ^ -{1 - X‘^V^)^ + T}{r,t) (8) 

- where A tunes the spatial correlation length and r] is white noise -, and by 
virtue of the following discretization of the Laplacian (not to be mixed 
with the unit length A) 

^ijkl = ^(6+l,i + ^ij+l + + 6,j-i - 4^ij) , (9) 

one finds the Fourier filter 

= 1 - |^cos(A;i^) -I- cos{kyA) - 2j (10) 

where we have defined 

k = (kx,ky) with kx = and ky = . (11) 

IjX^ Ljy^ 

In the asymptotic stationary limit typical realizations are marbled or patchy 
structures like the one shown in the left of Fig. 3. The structure function 




Fig. 3. The stocheistic RDE (8) typically generates a marbled pattern (left: Lx = 
Ly = 200 pixels, A = 15 pixels, e/r = 30000, entropy: 5.32 bit) whose structure func- 
tion (right; plotted in logarithmic grey scale) is rotationally invariant (cf. Eq. (14)), 
thus evidencing isotropy. 



Snv{t) = 



LxLyA^ 



(12) 



quantifies the weight of the Fourier mode p.u just as the power spectrum does 
for signals varying in time. The structure function asymptotically reaches a 
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stationary value^ 

Slu = ^ (13) 

which, in the continuum limit, i.e. A 0, Lx = Ly = L oo with keeping 
LA fixed, can be shown to approach 

= = (14) 



Prom Eq. (14) and the right of Fig. 3 we see that the structure function is 
rotationally invariant, thus evidencing isotropy of the generated stochastic 
fields. 

We could employ a pattern like in the left of Fig. 3 for a demonstration 
of our idea to use a spatially correlated noise pattern as input signal whose 
detection is enhanced when adding stochastic patterns of the same type. How- 
ever, when it comes to explain differences in the transinformation we also aim 
at a visual understanding. For this reason we looked for a class of stochastic 
patterns with more pronounced characteristics; we chose stochastic Swift- 
Hohenberg patterns (SHPs) which were generated by applying the method of 
Garcfa-Ojalvo et al. [10] to the linearized Swift-Hohenberg equation (SHE) 

r dtar,t) = -(r + A^[g^ + + r,(r,t) . (15) 

The SHE [11] describes the onset of Rayleigh-Benard convection in the vicin- 
ity of the instability point, i.e. for r close to zero^. Using the discrete Laplacian 
(9) the related Fourier filter is computed to 



^ + (M)‘^ + 4{Xqf~^cos{kxA) + cos{kyA) - 2 



-I- 






cos{2kxA) + cos{2kyA) — 16 cos{kxA) + cos(fcy/i)j 



-1-4 



cos ^[/cx -I- ky]/^ -I- cos ^[/Cj, - ky]A^ 



-flO 



(16) 



In the continuum limit the stationary structure function assumes the intu- 
itively expected radial dependence 

s;„(k) = s-„(k) = , (17) 

again proving isotropy of the generated patterns. 

^ In fact, formula (13) is not restricted to the RDE since it is derived from Eq. (7) 
for arbitrary positive 

^ The SHE also involves a cubic nonlinearity whose contribution to the linear 
approximation was absorbed by renormalization of r. 
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A typical pattern - generated with the parameters Lx = Ly = 200 pixels, 
A = 1 pixel, q = 27t/ 15 inverse pixels, r = 10“® , e/r = 200 - is seen in the 
left of Fig. 4. Its structure function, plotted in the right of Fig. 4, displays a 
dark black ring around the center which indicates the isotropic predominance 
(note the logarithmic grey scale!) of the basic wavelength tuned by q. 




Fig. 4. Left; A typical pattern generated by the SHE (parameters Lx = Ly = 200 
pixels, A = 1 pixel, q = 27t/ 15 inverse pixels, r = 10~®, e/r = 200, entropy 4.12 
bit). The thin black ring in the structure function (plotted right in logarithmic grey 
scale) relates to the isotropic predominance of the basic wavelength tuned by the 
parameter q. 



2.2 Probing an Input Pattern 

with Similarly Structured Noise Fields 

In what follows, the left of Fig. 4 served as input to the array of threshold 
devices. It should be mentioned that roughly half of all pixels of the original 
SHP had values near to the maximum; to be able to arrange for a subthreshold 
condition required to shift them back a bit. The result of this manipulation 
can be seen from the grey value histograms in Fig. 5. 

Before actually letting the manipulated signal pattern pass the threshold 
system stochastic patterns were added to it. In one case the noise fields were 
spatially white, in the other situation the input was superimposed with SHPs 
generated by using exactly the parameters X,q,r employed to generate the 
original input SHP. The averaging was done with N = 50 output images each. 
The essential parameter e/r, ruling the variance e* of the additive stochastic 
patterns, was varied in a range were a maximum could be found; this rele- 
vant range turned out to be three orders of magnitude less than the noise 
intensity set up to generate the input image. The efficiency of reconstruction 
was assessed by computing the transinformation between the averaged out- 
put and the input (SHP). The results are depicted in the top of Fig. 6: left 
for SR and right for SSR conditions respectively. As can be read easily from 
the curves, the detection of the input SHP is enhanced under both SR and 
SSR conditions when probing the input not with spatially uncorrelated noise 
fields but with stochastic SHPs. 
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Fig. 5. The grey value histogram of the SHP before (top) and after (bottom) the 
shift manipulation; note that a minimal shift of the threshold will effect a change 
from the SR (subthreshold) to the SSR (equipMtition) condition. 
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To relate the discrepancy in numbers to differences in visual perception 
we plotted in Fig. 6 the original input (lower left), a best image^ achieved 
with Swift- Hohenberg noise (lower middle), and a best image with spatially 
white noise (lower right). Clearly, the averaged output produced with SHPs is 
smoother than the corresponding white noise results; on the other hand, some 
texture showing up in the dark regions (of the lower middle image) might 
rather be a consequence of superimposing fifty output images produced with 
SHPs than reflecting genuine features of the input pattern. Note that the peak 
transinforraation for the SR condition is even larger than the related peak 
value for the SSR condition. This fact is rooted in the grey value histogram 
of the input SHP: Since half of the pixels fall in a very narrow range of 
dark grey values the beneficial role of noise is limited by blurring of the dark 
structures, the latter occurring more rapidly when fixing the threshold close 
to this prevailing grey value, i.e. in the SSR case. 

When applying stochastic SHPs to an input which is not of the same kind 
we do not expect a detection enhancement. In order to check this we did the 
same analysis for the image already used in Fig. 2. The threshold was fixed to 
render a noise-free transinformation of 0.5 bit, i.e. halfway between SR and 
SSR. The transinformation spectra for both classes of stochastic patterns 
nearly coincided. However, as can be seen in Fig. 7, in the context of visual 
perception their pros and cons are found at different ends. 

^ We produced many averaged output images with optimum noise intensity and 
selected the image rendering maximum transinformation 







Fig. 7. Input (left) and best images for the SHP (middle) and white noise (right) 
patterns (again with N = 50). The peak transinformation, which determines where 
to look for a best SHP image, turned out to be insensitive to slight variations in 
the correlation length, fixed by choice of 2izq~^ = 15 pixels. 
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3 Conclusions 

We have used grey value images to illustrate the phenomena of SR and SSR. 
For completely subthreshold signals and using the transinformation to char- 
acterize noise-induced signal detection, SR occurs inevitably. Strictly speak- 
ing, SSR already sets in when averaging the output over two realizations. 
However, the effect becomes notably only when performing the average over 
sufficiently many output images. In the context of image reconstruction the 
notion of SSR boils down to the statement that “grey beats black and whit^’ . 

The idea that detection can be enhanced by not using spatially uncor- 
related noise patterns but stochastic patterns which reflect features of the 
input, was exemplified by utilization of stochastic SHPs. These patterns are 
easily generated by combining Gaussian random fields with the Fourier filter 
of the linearized SHE. An enhancement, indeed, could be tracked down by 
comparison of maximum transinformation. In contrast, stochastic SHPs and 
spatially white noise fields yield comparable transinformation when applying 
them to an input pattern which is not dominated by Swift-Hohenberg like 
features. So far these investigations remain numerical evidence. 

♦ ♦ * 

Remarks by J. Garcfa-Ojalvo and N. G. Stocks are gratefully acknowledged 
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Abstract. This paper discusses recent developments in the study of resonances in 
stochastic excitable systems. It describes how the classical phase locking regions 
in the forcing amplitude-forcing period subspace are modified by noise, and how 
an extension of this subspace that includes noise intensity reveals new features of 
stochastic phase locking and stochastic resonances. It also briefly reviews neuron 
models used to investigate these issues, and in particular contrasts their coupling 
of noise to the excitable dynamics. 



1 Introduction 

The response of excitable systems to deterministic and/or stochastic forcing 
has received much attention in the last decades (Glass and Mackey, 1988). 
Responses to suprathreshold periodic forcing include n:m phase locking pat- 
terns with m firings for n forcing cycles, as well as chaotic firing patterns. 
These patterns result from the nonlinear interaction of internal time scales 
with the external time scale of the input. Stochastic forcing further turns a 
quiescent excitable system into a stochastic oscillator (Treutlein and Schulten 
1985). This can modify the phase locking structure, and can strongly affect 
the frequency sensitivity (“tuning”) characteristics of the cells (Collins et al, 
1995; Longtin 2000). Furthermore, other new phenomena arise from stochas- 
tic forcing, such as coherence resonance (Pikovsky and Kurths 1977), stochas- 
tic resonance (Gammaitoni et al. 1998), mean frequency locking (Shulgin et 
al., 1995) and noise-enhanced phase coherence (Neiman et al., 1998). At the 
core of these phenomena lies the concept of resonance. 

Our paper is a brief survey of deterministic and stochastic resonances in 
neural systems with periodic and/or stochastic forcing. It is not meant to 
be comprehensive. Rather, its intent is to summarize and contrast some of 
the major models recently used to study these phenomena, and to present 
recent developments in the study of such resonances. We are primarily con- 
cerned with the effects of neural noise, due e.g. to ionic channel conductance, 
synaptic failure, and random synaptic inputs, rather than of random phys- 
ical stimuli. Section 2 describes three popular neuron models used to study 
stochastic neural dynamics. Section 3 looks at a neural input-output function 
and at how neural noise can linearize this function. Section 4 discusses deter- 
ministic resonance, and how noise turns the excitable system into a stochastic 
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oscillator and associated consequences for tuning. Section 5 considers a new 
representation of phase locking patterns in parameter space, and discusses 
multiple stochastic resonances. Perspectives on suprathreshold noisy phase 
locking for modeling purposes are the subject of Sect. 6, and the paper con- 
cludes in Sect. 7. 

2 Basic Neuron Models 

The standard dynamical description of a neuron is in terms of the Hodgkin- 
Huxley formalism: 

CdV/dt = E ^ion ^syn ^app (1) 

— ^ ^ 1^) T 9exci\^exc 1^) "t“ Qinhi^inh d" ^app 

i 

where V is the voltage at the spike generating zone, and C the membrane 
capacitance. lapp designates external bias currents. lion accounts for the non- 
synaptic ionic currents. Synaptic currents are divided into excitatory cur- 
rents, gexc{Vexc ~ V), and inhibitory currents, ginhiyinh ~ V). The Vi are the 
Nernst “reversal” potentials for each ionic species, and Vexc and Vinh are, 
respectively, the excitatory and inhibitory reversal potentials for each par- 
ticular synapse. The gi's are the maximal conductances, and Si and Si are, 
respectively, activation and inactivation gating variables. The latter, which 
take on values between zero and one, follow first-order dynamics with voltage- 
dependent parameters. The excitatory (</exc) and inhibitory [gink) synaptic 
conductances may also involve gating variables. 

The effect of synaptic input at a given time depends on the value of the 
voltage. For example, if the voltage is equal to the reversal potential for a 
given synapse, any amount of synaptic conductance change will nevertheless 
produce zero current from that synapse. Under certain conditions, such as 
when conductance changes are small compared to the inverse of the input 
resistance of the cell membrane, and when the reversal potential exceeds the 
threshold voltage, synaptic input can be approximated as a constant current 
source Igyn = Vgyngsyn (sce e.g. Koch 1999). This is often assumed in simple 
integrate-and-fire type models (see below, and e.g. Brunei and Sergi, 1998). 
Further, the arrival of action potentials at synapses can be modeled as a train 
of Dirac delta functions, such that if the voltage dependence is neglected, 
hyn{t) = JiS{t — 1|), where the first sum is over all N synapses, and 

the second, over all firing times at each synapse; J, is the synaptic efficacy, 
related to its maximal conductance. 

An input spike train is often assumed to be a Poisson process with rate 
Nu, where i/ is the mean rate at each synapse. If v is small, and the Ji are 
small (i.e. many synaptic events are needed to fire the cell), yet Nv ^ 1, the 
Poisson process can be approximated by a diffusion process with same mean 
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and variance. For the simple case Ji = J, we have the mean fi = Ji/N, and the 
correlation function is {Isyn(t)l 3 yn{t')} = - t') = J‘^uN6{t - t'), where 

a denotes the intensity of this white noise process. In this case, and assum- 
ing the voltage-independent approximation discussed above, synaptic input 
may be modeled as Gaussian white additive noise on the voltage dynamics. 
Further, synapses also have their own (usually) first-order dynamics. Then, if 
the diffusion approximation is vahd, the first-order synaptic current dynamics 
are approximately driven by Gaussian white noise (see e.g. Brunei and Sergi, 
1998); in other words, the synaptic current is a lowpass-filtered version of the 
train of delta-functions. Isyn{t) is then an Ornstein-Uhlenbeck (OU) process, 
which in turn drives the voltage dynamics at the spike generating zone of the 
neuron. This justifies using OU noise for input to other models such as the 
analytically and computationally simpler Fitzhugh-Nagumo (FHN) model. 
This reduced model is obtained from HH by keeping only the fast voltage 
variable v and a slow recovery variable w. Below we focus on this model with 
additive periodic and/or stochastic forcing (Longtin 1993): 

dv 

= v(v - 0.5)(1 —v) — w -b Asin Wot + / -I- rf(t) (2) 




The bias current I encompasses the mean external and synaptic currents, and 
r] is an Ornstein-Uhlenbeck (OU) noise with correlation time tc and variance 
D/tc\ for the simulations presented below, D will denote the noise intensity of 
this OU process. This noise is useful to investigate the effect on the dynamics 
of noise variance and bandwidth. Below, this system was integrated as in 
Longtin and Chialvo (1998). FHN still has realistic excitable dynamics with 
a deterministic resonance as many neurons do (Guttman et al.l974). Our 
parameters are / = 0.04,6 = 0.15, e = 0.005, tc = 10“^, the threshold is 0.5, 
and a firing is counted only if separated from a previous one by at least the 
refractory time of Tr = 0.4 sec (equivalent to w 1 - 2 msec in real time). 

A leaky integrate-and-fire one-dimensional model (LIF) (Knight, 1972) 
assumes that the gi in HH are not voltage-dependent (gating variables are 
zero or one): 






V) + 9exc{Vexc — U) -|- 



9inh{Vinh V) -|- ^ ^ 9i{^i ~ + ^app 

9i 



( 4 ) 



The voltage is reset to H after the voltage reaches a threshold value 9. Synap- 
tic inputs simply modify gexc and gi„h in time, and as mentioned above, in 
the simplest cases, synaptic current does not depend on V but simply enters 
the dynamics additively. 
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3 Linearization of the Transfer Function 



An excitable system can be described by a transfer function or “transduc- 
tion” function, i.e. a function that relates the instantaneous firing rate to the 
instantaneous value of the input current (usually synaptic or from an exter- 
nal current source) . Sufficiently slow signals can then be seen as modulating 
the input currents, and via the transduction function, the firing rate. Fur- 
thermore, this function depends on the intensities of the stochastic processes 
driving the neuron. We begin by quoting a result due to Ricciardi (1977) for 
the mean firing rate R of a LIF neiuron governed by the dynamical equation: 

dV 

G-^-gV + I^am, (5) 



where g is assumed here to be a constant, I a constant bias current, and 
is the stochastic input current of standard deviation a. This rate is given by: 






R = dx exp(o:^) [1 + erf(x)] 



( 6 ) 



Here Tre/ is the absolute refractory period, = C/ff is the membrane time 
constant, 6 is the threshold voltage, H is the reset voltage after a spike, 
and Vas is the steady state voltage for <7 = 0: 14s = Ijg- A plot of R{I) 
versus I yields a sigmoidal function (Fig. la). Since R is also a monotonically 
increasing function of <j, the sigmoid for <j\ lies under that for a 2 > cri. We 
show here that the quantity dR/dl gives the behavior of the slope of this 
transfer function as a function of a. This slope is given by 



dR 

dl 





fe-iV 




r 


— exp 


— 




l-f erf ( ) 


a 


\ / 




L V /J 



+a ^ exp 



H-I 



1 -I- erf 



H-I 



(7) 



A plot of this slope versus cr is given in Fig.lb. The non-monotonicity of this 
relation accounts for the low-frequency SR exhibited by this model (Bulsara 
et al., 1996; Shimokawa et ah, 1999a, 1999b). This is because a slow input 
signal is equivalent to a slow variation of the current I. In turn, slow varia- 
tions of I are translated into slow variations of the firing rate. The linearity 
of this relationship is maximized at an intermediate value of ct. A plot of the 
mean firing rate versus the bias parameter also yields a sigmoidal function 
for the stochastic FHN system (Treutlein and Schulten, 1985; Collins et al, 
1995; Chialvo et al, 1997). The dependency of this slope on noise intensity 
also underlies, for slow signals, the non-monotonicity versus noise intensity 
of quantities such as the power spectral amplification or the linear correla- 
tion between the input signal and the firing rate averaged over a small time 
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Fig. 1. a) Mean firing rate (in Hz) of a leaky integrate and fire model as a function 
of mean bias current I according to Eq.6 with T^e/ = 2 msec, r-m = 10 msec, H = 0 
and 0 = 20 (as in Brunei, 1996). Note that the maximal firing rate is IfTrcf = 500 
Hz. b) The slope dR/dl calculated from Ekj.7 versus the standard deviation cr of 
the stochastic input current. 



window. The value of noise intensity that maximizes such quantities is found 
to be independent of the frequency of the signal in this slow signal limit 
(Longtin and Chialvo, 1998; see also Jung 1994). 

4 Deterministic Resonance and Spontaneous Firing 

The models described above have an autonomous oscillation regime arising 
via a bifurcation from an excitatory regime as e.g. lapp is increased. The 
HH and FHN models have a deterministic resonance; they behave as un- 
derdamped oscillators. The LIF model above does not. Figure 2 shows the 
organization of different steady-state periodic firing patterns in the usual sig- 
nal amplitude-period subspace for the FHN model described in Sect. 2. Only 
three are shown for D = 0. The curves correspond to A,T pairs above which 
a given n:m locking occurs (Arnold tongue boundaries). The subthreshold 
regime lies below the 1:0 curve. One sees that the threshold for a given n:m 
pattern depends on T = 27t// 3, and is lowest for a “preferred period”. The 
preferred period for 1:1 is close to the period of the limit cycle that is reached 
for larger lapp, and to the value of T yielding the largest subthreshold voltage 
response. 

In the presence of noise and without signal, “spontaneous firing” occurs. 
Because of the resonant nature of the FHN and HH systems, this noisy fir- 
ing has a certain coherence (Longtin 1993). In fact, this coherence can be 
maximized by a finite noise intensity (Pikovsky and Kurths, 1997; Lindner 
and Schimansky-Geier, 1999). In other words, the noise induces the limit cy- 
cle from the excitable regime, a phenomenon referred to in this context as 
coherence resonance. 






Adiabatic and non-adiabatic resonances in excitable systems 



177 



With periodic forcing, the 1:0 boundary no longer exists, and the noise 
blurs the boundaries between the phase locking curves. Each curve can now be 
interpreted as the set of A-T parameter pairs yielding a given time-averaged 
phase locking ratio (see e.g. Longtin, 2000). Thus, an n : 1 ratio means an 
aperiodic firing pattern with one spike for n stimulus cycles on average. Figure 
2 shows that the noise opens up the Arnold tongues at periods larger than 
the preferred period. Our recent study (Longtin 2000) has shown that the 
shape of these tuning curves for T > 1.5 can be deduced from an adiabatic 
theory based on an Arrhenius law. However, the frequency dependence of the 
subthreshold voltage response, related to the deterministic resonance, must 
be taken into account. Without this, two forcings with same A but different T 
would be expected to produce the same mean firing rate, which is clearly not 
the case (Fig.2). Forcing near the preferred T produces the largest voltage 
excursions, increasing the likelihood of firings. For T < 1.5, the recovery 
variable also determines the firing probability, and the escape time problem 
is then intrinsically two-dimensional. 




Fig. 2. Boundaries between phase locking patterns in the standard forcing ampli- 
tude-forcing period subspace for Eqs.3. The 1 : 0, 1? = 0 curve defines the boundary 
between sub- and suprathreshold amplitudes. The V-shape of the D = 0 boundaries 
is due here to the use of sinusoidal forcing. For finite D, the average curves (1 : 1) 
and (2 : 1) move into the “subthreshold” region for T > 1.3. 



5 D — T Subspace and Stochastic Resonance 

We now consider the noise intensity-forcing period “D - T” subspace for the 
study of stochastic phase locking and resonances. Figure 3 shows the location 
of the 1:1 “DT” stochastic phase locking curves for three values of A. The 
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curves are either monotonic or non- monotonic. For A = 0.01, the forcing is al- 
ways subthreshold, and a monotonic curve results. For A — 0.015, the forcing 
is actually suprathreshold over a certain range of T, but the curve is never- 
theless monotonic. Higher amplitudes can be seen as bringing on resonances 
(there are actually two dips for A = 0.02) from this DT perspective. And 
for certain A — T combinations, the system is already firing in a 1:1 manner 
without noise, as is the case for A = 0.03 and (approximately) 1 < T < 2. 
We also note a recent study of higher (but subthreshold) amplitude SR in 
a LIF model (Shimokawa et al., 1999b) in which mean discharge frequency 
locking was found to underlie signal enhancement. At higher frequencies, non- 



NOISE INTENSITY THRESHOLD FOR <1:1> 




Fig. 3. Stochastic phase locking curves in the D-T subspace for different sinusoidal 
forcing amplitudes A in the FHN system. Points correspond to averages over three 
realizations of 100 periods. For A — 0.02, the forcing is suprathreshold for T < 1.7, 
and for T < 1.21 for A = 0.015. Also, for A = 0.03, the points on the x-axis actually 
correspond to Z) = 0. 



linear phase locking phenomena occur in the suprathreshold regime (see also 
Shulgin et al. 1995). For subthreshold signals, multiple stochastic resonances 
can occur as D increases (Longtin and Chialvo, 1998). Here we report on a 
transition from a single to a double stochastic resonance as D increases. Fig- 
ure 4 shows the power spectral density at the driving frequency for increasing 
D. For T = 1.1, a single maximum is seen, while for T = 0.6, two bumps are 
seen. Such multiple resonances were found when T < 0.9. Similar resonances 
have also been found in bistable systems (Jung and Hanggi, 1991). These sub- 
threshold resonances are perhaps related to the deterministic lockings that 
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exist for suprathreshold forcing, and which are induced by the noise. This is 
currently under investigation. 




Fig. 4. Power spectral density (PSD) at the forcing frequency S(a;o) computed 
versus D from spike trains for the PHN system. For each combination of period 
and noise intensity, the PSD was calculated from 50 readizations of 340 periods of 
the stimulus. 



6 Skipping from Suprathreshold Regime 

There has been much focus in the SR literature on the stochastic phase lock- 
ing that occurs when a subthreshold periodic signal drives a noisy nonlinear 
system. This produces the familiar multimodal residence time histograms 
(Gammaitoni et al., 1998). Suprathreshold signals can also produce such be- 
havior in the FHN system (Longtin, 1993). However, the histogram peaks in 
that study did not properly align with the integer multiples of the forcing 
period, and the histogram envelope did not vary smoothly with forcing para- 
maters as it did in experimental data and in the subthreshold regime. This 
was in part ascribed to the blurring of chaotic motion by noise. 

In Fig. 5 we show new results from a simulation of the FHN system at 
higher frequencies than those used in our previous study. The value of I is 
also higher (0.04 instead of 0.0), b is 0.15 rather than 0.2, and the forcing 
here is applied directly to the fast variable rather than the slow one as was 
done in Longtin 1993. The left panel shows the inter spike interval histogram 
for the noiseless dynamics; the motion is a 5:1 phase locking. Additive noise 
here causes the histogram to become multimodal with well-aligned peaks and 
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smooth envelope variations. There does not seem to be much chaotic activity 
nearby in parameter space. Also, the sinusoidal signal here is now actually 
rectified, i.e. only its positive part drives the voltage dynamics; the results are 
qualitatively similar even without rectification. Such rectification is justified 
for many sensory neurons which respond to only one polarity of a physical 
stimulus (such as the opening of channels when hair cells are bent in one 
direction). P-type electroreceptors of weakly electric fish exhibit histograms 
such as those in Fig.5b. Our recent study, based on a two-dimensional ver- 
sion of an LIF model to account for firing interval correlations, supports the 
notion of suprathreshold noisy dynamics in those cells (Chacron et al, 2000) . 
This motivates further theoretical studies of escape time distributions for 
suprathreshold dynamics. 





ISI (SEC) 



Fig. 5. Smooth skippmg-type firing patterns in the higher frequency suprathreshold 
regime of the FHN system. Interspike interval histograms are for (a) Z? = 0 (5 : 1 
phase locking and (b) D — 4 x 10“®. Parameters are u>o = 32, A = 0.06 and a 
rectified sinusoidal forcing is used to mimick synaptic input. 



7 Conclusion 

We have shown that the addition of noise to excitable dynamics brings a new 
perspective on issues of resonance and tuning. Noise linearizes the transduc- 
tion function of the neuron, allowing its firing rate to track slow input signals. 
It also changes the shape of tuning curves, especially for forcing frequencies 
below the preferred frequency of the neuron, i.e. toward the adiabatic regime. 
For higher frequencies, i.e. in the non-adiabatic regime of the neuron (Longtin 
and ChiaJvo, 1998; Massanes and Perez Vicente, 1999 ;see also Plesser and 
Geisel, 1999 for the LIF case), subthreshold resonances appear in the behav- 
ior of certain firing statistics; in fact, many can appear, as though statistical 
versions of the deterministic phase locking boundaries are expressed by noise 
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in the subthreshold regime. The study of those resonances will likely require 
analyses of the dynamics that account for the recovery variable behavior, such 
as the one recently proposed by Lindner and Schimansky-Geier (2000) . This 
is likely to be the case as well for the study of the supra-and subthreshold 
resonances found in the DT subspace (Fig. 3). 

This research was supported by NSERC (Canada). We thank Adi Bulsara, 
Jan Freund, Lutz Schimansky-Geier, Khashayar Pakdaman and Dante 
Chialvo for useful discussions in relation to this work. 
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The Lighthouse Model 
of a Neural Net with Delay 
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Abstract. This paper studies the impact of noise on phase locking in a net of 
N pulse-coupled model neurons, taking into account the dynamics of dendrites 
and axons. The axonal pulses are modelled by 5-functions. We admit a general 
dependence of the coupling strengths on the neuronal indices and on a delay time r. 



1 The Basic Equations 

First I briefly remind the reader of some basic features of real neurons. A neu- 
ron can be conceived as an element that receives inputs from other neurons, 
processes them and then sends out outputs to other neurons. The scheme is 
shown in Fig. 1. 




Fig. 1. Block diagram of neuronal connections and activities 



The soma of a neuron receives its inputs through dendrites in the form of 
electric currents. It then sums up over these inputs, which might be excitatory 
or inhibitory, and once a certain threshold is reached it fires. This means, it 
sends out short pulses along its axon, which then splits up and connects with 
the dendrites of other neurons via synapses. Once the electric signal carried 
by the pulse reaches a synapse, it causes vesicles to open and to release 
neurotransmitters that diffuse across the synaptic clift and eventually cause 
currents in the dendrites of other neurons. The messages sent out from a 
neuron via the axon are pulse-coded , i.e. the signal is encoded by means of 
time intervals between the individual pulses. More specifically, my model is 
based on the experimental observation (made on neurons of the visual cortex) 
according to which the axonal firing rate is proportional to the strength of 
the sensory input. It may well be, however, that different types of neurons 
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behave differently. Since I derived the basic equations elsewhere [1], I shall 
start from them directly. 

The generation of a dendritic current ip-mit) of dendrite m is described by 

^ ] ^mkPk '^mk) ( 1 ) 

k 

The coefficients amk called synaptic strengths, Pk{t — T) is a pulse of axon 
k with delay time r, 7 dendritic damping, a stochastic force, caused 

for instance by random opening of vesicles. A more general relation between 
axonal pulses and dendritic currents is given by 

t 

V'm(i) = ^ I Gmk{t,(T)Pkia - Tmk)d(T + (2) 

-L 

The kernel Gmk may contain fluctuations that result e.g. from the failure of 
the opening of vesicles. By means of a periodic, sharply peaked function /, 
Pk is expressed by a phase ^k 

Pk{t) = fiMt)) • 

The phase 4>k is subject to the equation 



^k{t) ~ ( XI <^km'<Pm{t ^km) + Pext,fc(^ “ '^km) ~ 

\ m 

S{X) is a sigmoid function, i.e. equal to zero for X 
0 < A” < Xm, and equal to a constant Sm- Pext k an 
threshold, F^^k a fluctuating force. 

In the following I assume that the neural net operates in the (practically) 
linear regime of S so that S in (3) can be replaced by its argument. It is a 
simple matter to eliminate tprn from (1) and (3), whereby we obtain 



0kj+F^,k{t). (3) 

< 0, quasi-linear for 
external signal, 0* a 



hit) + 'yhit) = XI it - Tjtm) 



l.m 



where 



+ Cj{t) + F^{t), 






'’’jtm — Tjm T '’'ml, 



( 4 ) 

( 5 ) 

(6) 
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Cj{t) = 7X^Pext,j {t - Tim) - T0j + Y^Pextj (7) 

m m 

~ 7-^0, j(^) "I" ^ ^ CjfnFil/,m {t ~ (8) 

m 

We will use the explicit form 

Pi{t) = f{(f>tit)) = -27m). (9) 

n 

The initial conditions in (4) are 

<^,(0) = <A,(0)=0. (10) 



2 Phase Noise 

In the following I take into account a single delay time r that allows me to 
demonstrate my general procedure. I assume that a phase locked state with 
(f)j = <j) exists and I study small deviations ^ = (Ci>"-i^a^) from that state, 

i.e. 



+ ( 11 ) 

As shown elsewhere [2], for small noise and corresponding small deviations 
the following difference equations for C = Cn times = nA, where Zl is 
the pulse interval, can be derived 

^n+l=^~'^^^n+Mn-M + Bn. ( 12 ) 

^ is a time-independent matrix proportional to ^ = i^jk)^ and 

tn 

Kn= j e-fr‘"-‘^)ff((7)d(7. (13) 

in — 1 

We measure the delay time r in units of zl, i.e. r = MA, M integer. The 
components Be^n of the fluctuating forces are assumed to obey 

< Bi^nBl'^n' >= Qu'^nn'- (14) 

We first seek the eigenvectors and eigenvalues of the matrix A (assuming that 
Jordan’s normal form has only diagonal elements) 

Av^ = A^v^. (15) 

We decompose according to 
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= ( 16 ) 

We project both sides of (12) on the eigenvectors and obtain 

+ xA-m + , ( 17 ) 

where B\f* = (v+5„) . By means of the correlation matrix K we can express 
correlations between the components of l*y means of correlations 

between and ^ 

< >= E 4 ^'’ > • ( 18 ) 

nn' 

In order to simplify the notation, we drop the suffix /r everywhere in (17) and 
put 



X^ — u. 

We first study 


(19) 


^n+l — 6 ^ "b ^nno 

with the initial conditions 


(20) 


= 0 for n < no 

and 


(21) 


^no+l = 1- 

The general solution of 


(22) 


^n+l — C ^ n ^ 7T-0 

can be written in the form 


(23) 


— C\l3i + C2l32... + Cm+iP'm+Ii 
where fUj are the solutions of the eigenvalue equation 


(24) 


pM+l _ g-7^^M _ o 0. 


(25) 


Taking into account the initial conditions (21), (22), we 
equations 


obtain the following 



^ — ^0 • ^Tio+l — 1: 



(26) 
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Tl — 71q + 1 . ^no+2 — ^ ^no + 1 ^^no+1 — M 6 ^ j 

n = no + 2 : ^„„+3 = e~^^U+2 = (28) 

U+i+M = (29) 

n = no + M + 1 : ^no+ 2 +M = e -)- a. (30) 

These equations allow us to determine the coefficients Cj in (24). We thus 
obtain the following equations 

ci^r +' + = 1’ (31) 

Ci/?r+' + C2/32"“+‘ + - + (32) 



^^^no+At+2 ^ ^^^no+M+2 ^ ^ + O. (33) 

The solutions of these equations can be simplified by making the hypothesis 



(34) 

which converts the equations (31) - (33) into 

di + d,2 ... + dM+i — 1) (35) 

diPi + d202 + + dM+iPm+i = e (36) 

di/3f + d2H^... + dM+i/3)^+i = (37) 

+' + d 2 ^ 2 ^+K.. + dM+i^jllti = + a. (38) 

The original hypothesis (24) can thus be written in the form 

Cn = + ■■■ + . (39) 



In order to make the dependence of on no explicit, we make the substitu- 
tion 
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Cn Cn,no- (40) 

We are now in a position to deal with the equation (17) that we recast into 
the form 



— e ^ d" M "h ^ ^ ^nno^ng • (41) 

no 

Since (41) is a linear equation, the solution can be found by means of the 
solutions of equation (20) 



n— 1 

$n ^ ^ ^n,no-®no- (42) 

no=0 

In the following we shall use the index n' instead of no. Inserting (39), (40) 
into (42), we thus obtain 



M+l n-l 

^n= (43) 

j=l n'=0 

Having in mind the same index /r, we may now evaluate the correlation 
function occurring in (18), namely 



M+l M+l 

< ^N^N' > = E E •iA E !>'i 

j=l = l n=0 

Assuming 



7V-1 N'-l 

yv-(n+l) ^ flW'-(n'+l) 



E/*? 



n^=0 



< > . 

(44) 



N>N' (45) 

and using (14), we readily obtain 

M+l N'-l 

< («(«' >= E E -'“-"‘'O- (46) 

j^j' = l n=0 

The sum over n can readily be performed so that we obtain 

M+l 

< ^N^N' >= Q E (1 - . (47) 

Under the assumption 



I 0jPj' 1'^ 1 



we obtain the very concise form 



(48) 
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M+l 

< ^N^N' >=QJ2 

j=l 


(49) 


Provided 


0<N-N'<M+1, 


(50) 


the expression (49) 
relations (35) - (38). 


can be considerably simplified by 
. Thus we obtain for instance 


means of the former 




< >= Q 


(51) 


and 


< ^N+\^N >= 


(52) 


By means of the substitutions 






Pi Pi,!i-> 


(53) 




dj — > 


(54) 






(55) 






(56) 



we can generalize the result (49) to 



M+l 

< >= : N>N', (57) 

j=i 

which presents under the condition (48) our central result. As we can see, in 
the case of delay with the delay time t = M A, where A is the pulse interval of 
the phase-locked state, the correlation function is determined by means of the 
strength of the fluctuating forces, but also by the eigenvalues of the equation 
(25). Since the eigenvalues may be complex, the correlation function (57) may 
show oscillatory behavior as a function of N. It is interesting that the index 
/r' drops out. The case in which N' > N can be covered by exchanging the 
indices [i and fi' . 
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3 Concluding Remarks 

In my above paper I studied the combined impact of noise and delay on 
the phase fluctuations of a phase-locked state. Readers interested in further 
properties of the lighthouse model are referred to my papers [2], [3] and [4] 
that deal with associative memory and the effect of several delay times on 
the stability of phase locking. This latter paper contains also a comparison 
with other approaches to neural nets, e.g. [5] - [14]. 
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Abstract. We study instantaneous response of a parallel array of stochastic res- 
onators to a weak periodic input signal contaminated by external noise. We show 
that arbitrary small signal can lock the phase of a collective response of a large 
enough array in a wide range of internal noise intensities. 



1 Introduction 

Small signals passing through a wide class of nonlinear systems can be greatly 
amplified by tuning the noise level in the system. This phenomenon, known 
as stochastic resonance (SR) [1] has attracted much attention and has been 
demonstrated to be important in various biological systems [2] , including very 
recent behavioral experiments with the paddlefish [3]. For extremely weak 
signals SR can be described in terms of linear response theory (LRT) [4, 5]. In 
this sense stochastic resonator can be judged as a filter with a noise-controlled 
characteristic. The susceptibility of stochastic system plays the role of transfer 
function in this case. On the other hand, for a large enough signal (but still 
subthreshold) SR is getting features of synchronization phenomenon [6]. In 
particular, for stochastic bistable systems the mean frequency of switching 
between metastable states of the system can be locked [7] as well as properly 
introduced instantaneous phase [8]. This makes SR be closely akin to classical 
synchronization in deterministic self-sustained oscillators. 

SR is a collective phenomenon so that in order to observe an enhance- 
ment of, say, signal-to-noise ratio (SNR), one should perform ensemble or 
long-time averaging. In experiments one should observe the output process 
for long enough time to obtain averaged measures of SR. For a single stochas- 
tic resonator in the limit of weak signal the noise-enhanced coherence can be 
observed only for ensemble averaged measures, such as spectral power am- 
plification or SNR, but not instantaneously in time [8]. On the other hand, 
the question of instantaneous matching of the input signal and the stochastic 
output is of great interest. This is especially important for biological system, 
since “observation time” during which a signal can be encoded by a sensory 
system is always limited. One way to enhance SR is use of ensemble of cou- 
pled [9] or uncoupled [10-14] stochastic resonators instead of a single one. 
In particular, it has been shown that in a parallel array of Hodgkin-Huxley 
neurons noise can improve timing precision. The synchronization of an array 
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of self-sustained oscillator by external noise has been studied in [15]. The 
focus of the present study is to answer the questions: whether the collective 
response of an array of stochastic resonators can be instantaneously matched 
to a weak signal contaminated by noise? And if yes, then what are the con- 
ditions of phase locking? 

2 The Model 

The general model we use is an array of N identical stochastic resonators act- 
ing in parallel [11,12,14]. The weak input, consisting periodic signal s{t) = 
Acos{Qt) contaminated by external noise n(t) with spectral density G„„(w), 
is common for all elements, while each element has its own statistically in- 
dependent internal noise with intensity D. Each element is characterized by 
the susceptibility D) which provides all information on the response of 
this element to a weak signal. The outputs of all elements are converged at 
the summing center: 

1 ^ 

XM{t) — 'y jt), (1) 

^ fc=l 

where Xk{t) is the state variable of A;-th element. For an array of neurons one 
may use the post stimulus time histogram (PSTH) as a collective variable 
XM{t) [12]. The thermodynamic limit of AT ->• oo is equivalent to the average 
over ensemble of internal noises and according to LRT the system behaves 
as a filter with transfer function xi^,D) [14]: x'^(t) = A \x(i^,D j cos(l7t-|- 

ip) -H T](t), where xp is the phase shift: tp = - arctan , and rj{t) 

is the transformed external noise having the spectral density, Gnn (uj,D) = 
\xin,D)\^Gnn(co). In the absence of external noise, 7]{t) = 0, in this limit the 
collective output is always in phase with periodic signal (up to the constant 
phase shift ip). One important effect for this model is SR without t unin g has 
been studied in [11]. 

In order to study instantaneous matching between the collective response 
XM{t) and the signal s{t) we introduce instantaneous phase and amplitude 
of XM(t) through the general concept of analytic signal [16]. The analytic 
signal is a complex function of time defined as z{t) = xuit) + ixniit) = 
a{t) exp [i^(f)], where XM(t) is the Hilbert transform of the collective output: 
XM{t) = i The integral in the last expression is taken in 

the sense of the Cauchy principal value. The functions a{t) and #(f) are 
instantaneous amplitude and phase. The concept of analytic signal was used 
to study noisy self-sustained oscillators [17] and recently has been applied 
to study the phenomenon of phase synchronization of chaotic system [18] as 
well to SR [8]. The instantaneous matching of input periodic signal and the 
collective output can be characterized by the instantaneous phase difference 
<P{t) = ${t) - nt. 
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In a noisy self-sustained periodic oscillator synchronized by the periodic 
force the dynamics of the phase difference follows stochastic differential equa- 
tion (SDE) of a general form [19]: ^ = /i — e sin0 -h ^{t), where A is the 
mismatch between the natural frequency of the oscillator and the driving 
frequency, e is the parameter of non-linearity and ^(t) is the noise term. This 
SDE describes motion of overdamped Brownian particle in the tilted periodic 
potential {/(</>) = -A(f> - e cos(<^). Noise acts against synchronization caus- 
ing phase slippage which corresponds to the transitions between the wells 
of The quality of stochastic synchronization is characterized by the 

effective diffusion constant, Dg/f 

D.„ = i i mm - <^(i))’] . (2) 

which raises monotonically with the increase of noise intensity. 

In distinct from the self-sustained oscillators, systems demonstrating SR 
usually have no any deterministic natural frequency but statistical character- 
istic timescales controlled by noise, instead. Nevertheless, the same synchro- 
nization behavior is possible for a large enough amplitude of periodic force. In 
this description, SR is manifested as noise enhanced phase coherence which is 
reflected in a global minimum of the effective diffusion constant versus noise 
intensity [8]. We show below, that enhancement of the instantaneous coin- 
cidence between input and output is also possible for an ensemble of large 
enough number of stochastic resonators. 

3 Numerical Simulation 

We start with the results of numerical simulations using two types of elements: 
the Schmitt trigger [21] and the Fitzhugh-Nagumo neuron model (FHN) [13]. 
The input in both cases consists of periodic signal and external broad-band 
noise. 

Single Schmitt trigger is described by the following expression [22] 

Xk(t + At) = sgn [K Xk{t) - - A sm{f2t) + n{t )] , (3) 

where K is the threshold level of the trigger, ^k (t) is Gaussian internal noise 
with correlation time Tc and intensity D. The input s{t) is represented by 
weak periodic signal {A K) contaminated by weak external Gaussian 
noise n{t) with intensity Q (Q < K). The dynamics of single FHN element 
is governed by a set of stochastic differential equations (SDE) 

exk = Xk {xk - (I - Xk) - Wk + rjk (t ) , 
ii>k — Xk ~ Wk — [b + A cos(f2t) -h n{t)], 

Tc Vk = -rjk + V^^k{t), 



(4) 
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where r]{t) stands for internal noise in A:-th element and ^k{t) is Gaussian 
white noise, n{t) is Gaussian external noise. SR in a single FHN (4) has 
been studied in detail in [23]. The value of parameter b is taken far from its 
bifurcation value (bo = 0.264). In numerical simulations of the array of FHN 
we calculate PSTH and use it as a collective variable of the system. 




Fig. 1. The instantaneous phase difference of the array of Schmitt triggers for 
indicated values of internal noise intensity: (a) N — 100, (h) N = I, D = 0.061. 
The parameters are K — 0.2, A = 0.02, Q = 0.03, ^2 = 0.5, Tc = 0.01. 



The evolution of the instantaneous phase difference between the 
phase of the collective variable and that of periodic signal for the array of 
100 Schmitt triggers is shown in Fig.l,a for different values of internal noise 
intensity. For an optimal noise intensity the instantaneous phases of the col- 
lective output and of the periodic signal are locked in course of observation 
time. In this case the mean frequency of collective output {oj) = {^) matches 






194 A. Neiman 



the frequency of periodic signal. With lower or higher levels of internal noise 
the phase difference demonstrates slips and its dynamics can be qualitatively 
described as Brownian motion in a periodic potential. Therefore the collective 
output of the array demonstrates synchronization-like behavior. We underline 
that a single element can not be synchronized for the weak periodic signal 
used in simulations. To illustrate this we show in Fig.l,b the phase differ- 
ence for the single Schmitt trigger. Even for the internal noise intensity at 
which the mean switching rate matches the frequency of periodic signal the 
instantaneous phase of output signal still not locked and the phase difference 
performs random walks. 





Fig. 2. The effective diffusion constant versus internal noise intensity for the arrays 
of Schmitt triggers (a) and of Fitzhugh-Nagumo neurons (b) for indicated numbers 
of elements in the arrays. The parameter values for the Schmitt triggers are the 
same as in the previous figure. The parameters for the Fitzhugh-Nagumo neurons 
are; e = 0.005, b = 0.12, A = 0.05, H = 0.75, Q = 10"^ Tc = 0.01. 
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We also calculate the effective diffusion constant Dgf f as a function of in- 
ternal noise intensity for different number of elements in the array (see Fig. 2). 
For an optimal noise intensity the effective diffusion constant takes its min- 
imum and diffusion becomes extremely slow. In other words the mean time 
between phase slips is very large compared with the period of input signal. 
Detailed simulations have verified that the effective diffusion constant takes 
its minimum for a noise intensity at which the spectral power amplification 
(SPA) takes its maximum, e.g. the collective output is most phase coherent 
in the regime of stochastic resonance. 



4 Approximate Theory 



Let us consider large but finite number of elements in the array, N ^ 1. In 
the limit A' — i oo of the output signal, will be contaminated by a 

weak finite-size fluctuations coming from the internal noise of elements: 



XM{t) ^ x^{t) -b C(i) = ^\xi^,D)\ cos{nt + i[j) + T]{t) -b C{t), (5) 



where the finite-size noise ({t) possesses the spectral density 

Gcc(ca,D) = ^G(“j(c^,D), (6) 

with (w, D) being the spectral density of the unperturbed (in the absence 
of input signal, A = (Q = 0) element in the array. We also note that due to 
summation and large N both the transformed external noise r]{t) and finite- 
size C(i) can be treated as Gaussian noises according to the central limit 
theorem [24]. 

Let us specify the elements in the array as symmetric bistable systems 
with states variables Xk{t) = ±1. Each element possesses the susceptibility 
and the unperturbed spectral density 






1 A 
D A-iw’ 






A 

A2 -b ’ 



(7) 



where A = \{D) is the noise-controlled characteristic timescale of the ele- 
ment: A = ^ exp (— ^)- We also suppose that external noise is Gaussian 
and with correlation time much smaller than A and with intensity Q 1. 
The Gaussian noise ■&{t) = r]{t) + C{t) in Eq.(5) possesses the spectral density 

G^^{uj,D) = and is described by a linear SDE [25], ?? = 

-A?9 -b where w{t) is Gaussian white noise, {w(t)w(t + s)) = 5(s) 

and V is its intensity given by the expression V = X ^ j • Differentiat- 

ing the expression for the collective variable (5) over the time and excluding 
noise terms we arrive to the following SDE 



xm 



— Xxm + cos(f?f) -b 



( 8 ) 
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This SDE, describing evolution of collective variable in the limit of LRT and 
large number of element in the array, represents periodically driven Ornstein- 
Uhlenbeck process [26]. Note, that the parameters of SDE (8) depend on the 
internal noise intensity. 

Let us consider the asymptotic probability density p{xm , t) which is given 
by Gaussian distribution [26]: 



p{xM,t) 




A 




AX 



cos{f2t + ij;) 



( 9 ) 



where ij} is the phase shift from the LRT. The asymptotic probability density 
is shown in Fig. 3 for different values of internal noise intensity. For conve- 
nience we use in this figure the phase 0 = (it + ip varying from 0 to 27 t 
instead of time. For weak and large internal noise intensities the magnitude 
of p{xm,(^) with respect to xm is small and p{xm,0) is nearly uniform with 
respect to 6. However for an optimal noise, p{xm,6) possesses well expressed 
peak with respect to phase. Therefore, the asymptotic probability density re- 
flects both the phenomenon of stochastic resonance and the noise-enhanced 
phase coherence. 

To elucidate the noise-enhanced phase coherence explicitly we introduce 
the instantaneous phase and amplitude of the collective variable using the 
concept of analytic signal. Due to linearity of SDE (8) we get SDE for the 
Hilbert transformation immediately: xm = -Xxm + ^ sm{nt) + V^w{t), 
where w{t) is conjugated with w{t) via the Hilbert transform and is also 
Gaussian white noise. Introducing the phase difference as 4>{t) = ^{t) — fit, 
we arrive to the following SDEs for the instantaneous amplitude and phase 

a = -Xa+ ^ cos4> + 

^ = -f] — sincp + - V^W 2 (t), ( 10 ) 

aD a 

where noise sources Wi{t) and W 2 {t) are W\{t) — cos{^)w{t) -|- s'm{^) w{t), 
W 2 {t) = sin(<f) w(f) -cos(?P) wit). The obtained equations are similar to those 
for amplitude and phase of periodically driven self-sustained oscillator [19]. 
However the coefficients in Eqs.(lO) depends on internal noise intensity D. 
SDEs (10) are highly nonlinear and no exact analytical solution is known. Let 
us consider the case of no noise {wi{t) = W2{t) = 0) which corresponds to the 
limit Af — > oo, <3 -> 0. The stationary values of the amplitude and of the phase 
difference from Eq.(lO) are: uq = (po = tp = — arctan(J?/A), 

which is in full agreement with LRT results for the conventional SR of a 
single bistable element [4]. 

To estimate the effective diffusion constant further simplifications are nec- 
essary. First, we neglect the amplitude fluctuations: a{t) = uq- Second, the 
noise term ■W 2 {t) can be taken as white Gaussian. With these assumptions 
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Fig. 3. Asymptotic probability density p(xm,0) (9) for different values of interned 
noise intensity: from the top to the bottom D = 0.02, D = 0.1 and D = 0.3. Other 
parameters are: A = 0.1, f2 = 0.01, N — 10®, Q = 0.01. 
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we obtain SDE for the phase difference alone: 



0 - \/X^ + sin^ + y/B(D) W3{t). (11) 



In Eq.(ll) W 3 {t) is again Gaussian white noise and B{D) defines its intensity 




A 



N 



( 12 ) 



SDE (11) describes Brownian motion in the tilted periodic potential U(<p) = 
Q(f) — \/A^ + 1?^ cos 0. Note, that in the limit AT — > oo the effective noise in- 
tensity B{D) is non-zero due to external noise. Therefore, even for infinitely 
large array there are phase fluctuations induced by external noise. The effec- 
tive diffusion constant for this potential can be calculated in the form (see 
Eq.(9.99) in [19]): 



- 



2tv 

exp 



1 + exp 
1 



7rf? A 

Wd)} 



B{D) L' 



A -b J? arccos ( - 



Q 

^/WTW 



]} 



(13) 



The effective diffusion constant is presented in Fig.4 as a function of internal 
noise intensity for different numbers of elements in the array. It possesses 
minimum at the value of internal noise intensity, corresponding to that when 
the spectral power amplification takes its maximum. At this level of internal 
noise the phase coherence in the system is maximal, i.e. the instantaneous 
phases of collective output and of periodic signal are locked for a longest 
time. With the increase of number of elements in the array D^ff approaches 
to its limit value (which is shown by the dashed line in Fig.4) and scales with 
N as Deff oc exp(-A/). Note, that theoretical predictions of the phase dy- 
namics are in qualitative agreement with the results of numerical simulations 
of arrays of Schmitt triggers and of Fitzhugh-Nagumo neurons (see Fig.2). 

Let us specify the conditions for the effective phase locking. We consider 
the collective output xm {t) and periodic signal to be effectively phase locked 
if their phases are entrained in course of at least 100 periods of signal. In other 
words, the mean escape time of instantaneous phase difference from a well 
of potential should be greater or equal to 100 • 27r/f7. Since the mean 
escape time in our case is just 1/De// [19], we obtain l/D^ff > 100 ■ 27r/J?. 
Imposing this condition, we calculate a minimal possible number of elements 
in the array at which phase locking in above defined sense is achieved. In 
the plane “internal noise intensity - number of elements in the array” we 
can plot a region inside which the phase locking condition is fulfilled. These 
regions for different values of signal frequency are shown in Fig.5. The first 
important feature we note is that at an optimal internal noise intensity the 
dependence N{D) possesses a minimum. Beyond this minimal threshold value 
the collective response of the array can not be phase locked for any noise 
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Fig. 4. The effective diffusion constant versus internal noise intensity (13) for the 
array of bistable elements. The limit N — ^ oo is shown by the dashed line. The 
parameters are: A = 0.01, 17 = 0.01, Q = 10“"*. 




D 

Fig. 5. Synchronization regions defined by the condition > 100 -2Trjn 

for different values of signal frequency. Other parameters are the same as in the 
previous figure. 



intensity. Therefore phase locking has a threshold character as it is for a single 
stochastic resonator synchronized by a large periodic force [8]. The second 
important note is that for a large enough number of elements (larger than 
a threshold minimal value) the collective output of the array of stochastic 
resonators can be phase locked in a finite region of internal noise intensity. 
The third feature is connected with low-frequency character of SR. With the 
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increase of signal frequency Q the phase locking regions become more narrow 
and the minimal threshold value of number of elements increases. 

One of the main assumption of the present paper is the identity of the 
SR elements in the array. Our theory indeed allows consideration of non- 
identical elements. In particular, if SR elements possess a distribution of their 
parameter, say the barrier height, it will result in an additional averaging over 
the parameter distribution in Eq.(5). We expect that the output signal can 
be additionally optimized by tuning the shape of the parameter distribution 
[27]. 

5 Conclusion 

The obtained results might be important to elucidate the role of SR in biolog- 
ical systems of neuro-receptors. We have shown that a weak periodic signal 
can be not only amplified via SR but also can lock the phase of a collective 
output of a large enough array of stochastic resonators. Since the real sensory 
system are usually highly redundant, i.e. contain a huge number of receptors, 
the mechanism of noise-enhanced phase coherence described above, might be 
of practical importance. A particular candidate is the electrosensitive system 
of the paddlefish which is represented by an array of tens of thousands of 
electroreceptors covering the rostrum of the fish and sending long axons to 
its brain. It was recently shown that paddlefish uses its electrosensory system 
to detect zooplankton [3]. Moreover, it was proved that paddlefish demon- 
strates SR behaviorally. Since both, paddlefish and its prey are moving, the 
instantaneous matching of a weak stimulus, generated by zooplankton, and a 
collective response of the electrosensitive system is required for location and 
caption of the prey. 
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Abstract. We discuss the problem of analysis of bivariate time series from the 
viewpoint of synchronization theory; it is assumed that the data are measured 
at the outputs of two possibly interacting self-sustained oscillators. We show that 
analyzing the relation between instantaneous phases of two signals we can estimate 
the degree of interaction between the systems. We briefly sketch how to apply our 
analysis to magnetoencephalography data. 



1 Introduction 

In the 17th century Christiaan Huygens observed anti-phase motion of the 
pendula of two clocks placed on a common support. Having reported this 
observation, Huygens also gave a brilliant and precise qualitative description 
of the synchronization phenomenon [8]. Nowadays, synchronization of peri- 
odic self-sustained oscillators, understood as the adjustment of their phases 
and frequencies due to a weak interaction, is well-studied theoretically and 
found numerous engineering applications [2,9-11], and influence of noise on 
the phase and frequency locking is described [26]. The notion of phase was 
extended to the case of chaotic systems [20], and thus the effect of phase syn- 
chronization^ of irregular (noisy periodic, chaotic, or noisy chaotic) oscillators 
was explained within a common framework [18,19]. Finally, phase synchro- 
nization was studied in stochastic [14, 15] and excitable systems [7, 13]. 

Detection of synchronization of irregular oscillators is often not an easy 
task. Simple visual inspection of signals, as was done by Huygens in his exper- 
iments with clocks, is mostly not sufficient, and therefore special techniques 
are required. Indeed, the mere determination of the phase from a complex 
time series, especially from a nonstationary one, is a complicated problem. 
In this paper we elaborate upon the methods of synchronization analysis 
of bivariate noisy data proposed in our previous works [21,23,28]; we are 
mainly interested in application to investigation of biological systems. Our 
main objective is to detect and quantify a weak interaction between oscilla- 
tory systems from the signals measured at their outputs. 

^ We use the term “phase synchronization” to tell it from “complete synchro- 
nization” understood as the exact coincidence of states in context of interacting 
chaotic systems. 
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2 Detecting Synchronization from Data 

2.1 Synchronization in Noisy Systems 

Synchronization is defined as the process of adjustment of frequencies and 
onset of certain relations between phases of two oscillators (or of an oscillator 
and of an external force, or of many oscillators), due to interaction. In the 
ideal, noise-free case the frequencies become equal, or, generally, n : m- 
locked, i.e. n/?i = ml? 2 > and the generalized phase difference, or relative 
phase, is bounded: 

\n(pi — m(j >2 — 5| < const , (1) 

where are phases, 5 is some (average) phase shift, and l?i ,2 =< >\ 

in the following we denote the relative phase n4>\ — m(f >2 as (pn,Tn- These con- 
ditions of frequency and phase locking hold in a finite range of a parameter 
that governs the frequency mismatch of uncoupled oscillators (synchroniza- 
tion region). 

In the real world noise is inevitable, and it tends to destroy synchro- 
nization. Due to noise, the relative phase can perform rapid 27 t jumps (phase 
slips) and diffuse, and is therefore unbounded.^ Hence, the region of frequency 
locking shrinks to zero, and synchronization survives only as a tendency: cou- 
pling makes the frequencies of two oscillators to become similar and reduces 
the phase diffusion, although generally the conditions of phase and frequency 
locking do not hold. 

2.2 Estimating Phases from Data 

Before we discuss how to detect synchronization in an experiment, here we 
briefly mention how the instantaneous phases can be estimated from data; de- 
tails of the practical implementation can be found in [23, 25]. The first method 
can be applied to any process that contains distinct marker events and can 
therefore be reduced to a spike train. This technique was used to analyze 
human electrocardiograms (ECG) [1,24,25] and spiking of electrosensitive 
receptors of a paddle-fish [12]. Indeed, an essential feature of the ECG is that 
every (normal) cardiocycle contains a well-pronounced sharp peak that can 
be localized in time with high precision; traditionally it is denoted as R-peak. 
Suppose that these peaks occur at times tk, k = 1,2,.... The time interval 
between two R-peaks corresponds to one complete cardiocycle, therefore the 
phase increase during this time interval is exactly 27 t; a similar consideration 
can be applied to the sequence of the spikes of a neuron. Hence, we can assign 
to the times tk the values of phase (/»(!*) = 2'nk, and for arbitrary instant of 
time tk < t < tk+i 

<p{t) = 2-Kk -b 27 t — . (2) 

tk+l — tk 

^ If the noise is bounded, the phcise slips occur if it is strong enough; for an un- 
bounded (e.g., Gaussian) noise the slips are always possible. 
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Determination of the phase via marker events in time series can be regarded 
as an analogy to the technique of Poincare section, although we do not need 
to assume that the system under study is a dynamical one [17]. 

The second technique can be implemented if the signal resembles a sine- 
wave with slowly varying frequency and amplitude. Phase of such a signal 
can be obtained by means of the analytic signal concept introduced by Gabor 
in 1946 [4]. To implement it, one has to construct from the scalar signal s(f) 
a complex process 

C(i) =s(t)-b^s/f(t)=A(^)e'^W , (3) 

where suit) is the Hilbert transform of s(t)\ the instantaneous phase ^(t) and 
amplitude A{t) of the signal are then uniquely determined from (3). Note, 
that although formally this can be done for an arbitrary s(t), A{t) and 4>{t) 
have a clear physical meaning only if s{t) is a narrow-band signal. 

2.3 Detecting Synchronization in an “Active” Experiment 

From the above definition of synchronization in noisy systems it is clear, that 
in order to detect synchronization we must have an access to the parameters 
of the oscillators or coupling. We have to look what happens to the frequencies 
and/or relative phase under variation of one of these parameters, i.e. we have 
to perform an “active” experiment. Sometimes, if the signals have a rather 
simple form and the noise level is low, it can be done by a visual inspection 
of the relative phase. For example, this was done in experiments of Graves et 
al. [5], where spontaneous respiration of anesthetized patients by a mechanical 
ventilator was studied; it was shown that there exist a range of frequencies of 
the ventilator, where the relative phase remains bounded, i.e. synchronization 
sets in. 

If the noise level is essential, a more complicated data analysis is required. 
So, in experiments on entrainment of the heart rate by a weak external sig- 
nal [1] synchronization was detected by calculation of the difference of the 
heart rate and of the external force. Although the region of exact frequency 
locking was absent, the frequency of the heart contraction tended to approach 
the frequency of the drive. The presence of synchronization was confirmed 
by computation of the diffusion coefficient of the relative phase as a func- 
tion of the frequency of the drive: there was a region where the diffusion was 
essentially reduced due to the external forcing. 



2.4 Analyzing the Data from a “Passive” Experiment 

Now we consider a “passive” experiment where we cannot change the pa- 
rameters of the systems and/or coupling, but just observe the signals under 
free-running conditions; this situation is frequently encountered in investi- 
gations of biological systems. First, we note that the estimation of the fre- 
quency ratio does not help here. Indeed, if the frequencies are related by 
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= mJ ?2 we cannot check whether this happens occasionally, or is a man- 
ifestation of synchronization, because we cannot alter a parameter and look 
whether the frequency locking still holds; due to the same reason, quantifi- 
cation of phase diffusion is of no help as well. On the contrary, if we find 
that, e.g., — 1.05, it does not exclude the occurrence of 1 : 1 syn- 

chronization, because frequent phase slips at the border of the locking region 
can make the frequencies different. Thus, the only means to get some insight 
into the interaction of the systems under study is to analyze the relative 
phase — W 02 ) and the frequency ratio J7i/J?2 can be only used 

to estimate the possible values of n and m. 

Noise complicates the process of synchronization, but in the particular 
case of the “passive” experiment it helps us to distinguish the occasional 
coincidence of frequencies from the true locking. Indeed, noise causes phase 
diffusion, and in the case of coincidence of frequencies, the distribution of 
Vu,m mod 27 t is nearly uniform, whereas presence of interaction manifests 
itself in the peak in this distribution [26]. This can be interpreted as the 
existence of a prefered value of the relative phase, i.e., as (statistically un- 
derstood) phase locking. Below we illustrate this with a description of a 
particular experiment. 



3 Synchronization Analysis of Bivariate Data: 

An Example 

For an illustration of our approach we analyze data that reflect the brain and 
muscle activity of a Parkinsonian patient: the recordings of the magnetic field 
outside the head noninvasively measured by means of the whole-head magne- 
toenchepalography (MEG) [6] and simultaneously registered electromyogram 
(EMG). Details of the experiment and preprocessing of the data can be found 
in [27-29]. The goal of this experiment was to study the electrophysiology 
of parkinsonian resting tremor. The latter is an involuntary shaking with a 
frequency around 3 Hz to 8 Hz that predominantly affects the distal por- 
tion of the upper limb and normally decreases or vanishes during voluntary 
action [3]. 

As yet, the dynamics of the resting tremor generation remain a matter 
of debate. Volkmann et al. [30] suggested a qualitative model which says 
that pathological rhythmic activity in the thalamus influences premotor areas 
which, in turn, drive the primary motor cortex. The latter affects the spinal 
motoneuron pool what results in the rhythmic muscle activity. The peripheral 
feedback comes back to the motor cortex via the thalamus (Fig. 1). It remains 
unclear whether the cortical areas synchronize their activity during epochs 
of tremor, and whether the muscle activity becomes synchronized with the 
brain activity. Next, the relationship between the cortico-cortical and the 
cortico-muscular synchronization has to be revealed. 
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Fig. 1. Generation of parkinsonian resting tremor involves cerebral areas, spinal 
cord, peripheral nerves, and muscles. As suggested by Volkmann et al. [30] rhythmic 
thalamic activity drives premotor areas (premotor cortex and supplementary motor 
area) which drive the primary motor cortex. The latter drives the spinal motoneuron 
pool which gives rise to rhythmic muscle activity. The peripheral feedback reaches 
the motor cortex via the thalamus. 



The gradiometer MEG system (Neuromag 122) used in this study is not 
appropriate for measuring deep, thalamic activity. Therefore, we analyze the 
cortical activity characterized by means of the MEG, as well as EMG that re- 
flects the dynamics of the spinal motoneuron pool (Fig. 1). For the subsequent 
analysis we use the signals that characterize the brain and muscle activity in 
the frequency range from 10 to 14 Hz and from 5 to 7 Hz, respectively. 

First we plot the 1 ; 2 phase difference between the signal from above the 
motor cortex and the EMG (Fig. 2) and the distribution of the cyclic relative 
phase ^n,m = mod 1. We see that the phase difference resembles 

a random walk motion, as we expect for noisy oscillators, and the presence 
of interaction can be revealed by analyzing the distribution of Next, 

we address the cortico-cortical interaction, i.e., we compute the 1 : 1 phase 
difference between sensorimotor^ and premotor activity (Fig. 3). Synchro- 
nization is practically not detectable from the plot of the phase difference, 
but can be seen in the distribution of To quantify the strength of the 
interaction we need some measure, or synchronization index, that shows how 
this distribution differs from a uniform one. 

A simple but efficient measure of synchronization^ is the intensity of the 
first Fourier mode of the distribution of the cyclic relative phase [22,23]. It 



^ We analyze the raw MEG, without reconstructing the cerebral current density 
which generates the magnetic field; therefore the spatial resolution is too low to 
separate the activity from the primary motor cortex and that from the primary 
sensory cortex. Accordingly, we use the term “sensorimotor activity” which means 
that it is originating firom one of both areas. 

* Two other synchronization indices are described in [22, 23, 28]. 
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Fig. 2. (a) The time course of the relative phase 1 ^ 1,2 = <Pmeg — 2<f>BMa demon- 
strates the behavior that is typical of noisy interacting oscillators. Three 30-seconds 
intervals marked by the boxes 1,2,3 are enlarged in (b), (c), and (d), respectively. 
These intervals are essentially different due to the nonstationarity of the system 
(the tremor activity starts at w 50 sec.). Indeed, within the first 30 sec the oscilla- 
tors can be considered as non-synchronized (b); the phase difference increases and 
the distribution of the cyclic relative phase <?i ,2 = '^i,2/27r mod 1 is almost uniform 
(e). The intervals shown in (c) and (d) and the corresponding unimodal distribu- 
tions of in (f) and (g) reveal synchronization of interacting systems, although the 
strength of synchronization is different. 



can easily be computed as 

pl,m = + (sin , (4) 

where the brackets denote averaging over time; note that no parameters are 
involved in the computation. The index varies from 0 (no synchronization) 
to 1 (perfect locking in the absence of noise). We can compute it in a run- 
ning window and hence quantify how the strength of interaction varies with 
time. Figure 4 shows the time course of the cortico-cortical and the cortico- 
muscular synchronization compared to the amplitude of the muscle activity. 
Obviously, the peripheral tremor activity reflects the time course of these 
synchronization processes. An important conclusion is that onset of synchro- 
nization between the activities of the premotor areas and sensorimotor cortex 
precedes the onset of cortico-muscular synchronization and tremor. 
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Fig. 3. The relative phase ipi^i for two MEG channels reflecting premotor and 
sensorimotor activity. FVom the first sight synchronization is absent. Nevertheless, 
chjinge of the scale (30-seconds interval marked by the box is enlarged in (b)) 
shows that the phase difference often jumps between the values that diflter by 27r; 
computation of the distribution of the cyclic relative phase !?i,i (shown in (c)) 
clearly indicates weak interaction between the underlying systems. 
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Fig. 4. The time course of synchronization. The amplitude (arbitrary units) of the 
EMG is shown in (a). The sharp incre£ise of the amplitude at P3 60s marks the 
onset of the perepheral tremor; its intensity decreases after « 290s. The indices of 
cortico-muscular and corico-cortical synchronization, pcm and pec, are shown in (b) 
and (c), respectively. The indices are computed in a running 10s window. It can 
be seen that the onset of the cortico-cortical synchronization precedes the onset of 
tremor, and the decrease of the strength of the interaction between premotor and 
sensorimotor activity at w 260s is followed by the decrease of the tremor activity. 
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A very important problem is the difference between our synchroniza- 
tion approach and traditional correlation (coherence) analysis. Coherence is 
widely used in neuroscience as a standard tool for the detection of interac- 
tion [16]. However, since the coherence analysis does not separate the phase 
and amplitude dynamics but treats the signals themselves, it addresses differ- 
ent aspects of systems interaction as compared to the phase synchronization 
analysis. This is illustrated in Fig. 5 and 6. 




/ [Hz] /[Hz] 



Fig. 5. Results of the cross-spectral analysis of two pairs of signals. The autospectra 
of a channel characterizing the sensorimotor and muscle activities and the coherence 
function are shown in (a), (b), and (c), respectively. The same is shown in (d), (e) 
and (f) for a channel over the right temporal cortex. (The spectrum of the EMG is 
repeated in (e) for convenience). It is seen that both MEG channels are coherent 
with the muscle activity, whereas only one channel is synchronized with it (cf Fig. 2 
and 6). 



In summary, we have briefly sketched the synchronization approach to 
analysis of bivariate data. By solving this inverse problem we detect the 
presence of interaction between the systems that we cannot affect directly. 
The implicit assumption used in our analysis is that we analyze coupled 
self-sustained oscillators. With our new tool we obtain different information 
compared to the coherence technique. In this way we expect to obtain new 
insight, in particular, into the functioning of motor control in humans. 
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Fig. 6. Phase difference ^i,i for the pair of signals that demonstrate significant 
coherence around 5 Hz (cf. 5(d),(e),(f))- Analysis of the phase diflFerence (a) shows 
the absence of synchronization. Enlargement of the interval marked by the box 
confirms that there are no plateaus in the plot of vs. time (b). This is also 
confirmed by the distribution of the cycUc relative phase (c). 
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Abstract. The formalism of irreversible thermodynamics is applied to dynamical 
systems giving rise to sustained oscillations and chaotic behavior. The variability 
patterns observed as the system runs over the attractor are compared with the 
variability of the indicators of the intrinsic complexity of the dynamics, such as a 
local generalization of Kolmogorov entropy, and some unexpected correlations are 
brought out. Dynamical systems giving rise to bistability are likewise investigated 
in the presence of noise and a periodic forcing, and it is shown that the occurrence 
of stochastic resonance has a clearcut thermodynamic signature. It is suggested that 
thermodynamic-like quantities provide useful characterizations of the complexity of 
dynamical systems driven out of equilibrium. 



1 Introduction 

It is by now established that when subjected to nonequilibrium constraints, 
large classes of dynamical systems give rise to complex behavior in the form 
of multiple steady states and of periodic or chaotic oscillations [1]. Under the 
action of stochastic perturbations impinging from the environment or gen- 
erated spontaneously by the system’s intrinsic fluctuations additional effects 
are induced in the form of transitions between the available states, reflecting 
their relative stability [2], Finally, in the presence of a weak periodic forcing a 
sharp, noise-induced amplification of the system’s response is observed under 
appropriate conditions, known as stochastic resonance [3]. 

Our objective in the present chapter is to explore the extent to which 
thermodynamic-like quantities provide useful characterizations of this dy- 
namical complexity. One of the principal attributes of thermodynamics is, 
indeed, the ability to provide a unified description of macroscopic systems 
that is largely independent of the details of the ongoing processes, in terms of 
state functionals depending on a limited number of observables. In thermody- 
namic equilibrium this description attains its highest power and universality 
thanks to the extremal properties of the thermodynamic potentials such as 
entropy (for an isolated system) and Helmholtz or Gibbs free energies (for 
systems at constant temperature). Away from equilibrium these functionals 
no longer follow universal trends and, as a matter of fact, the very notion of 
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thermodynamic potential breaks down. We shall therefore seek for alterna- 
tive key quantitites. In particular, we shall focus on entropy production [4], 
which accounts for the ways dissipation is generated within the system, and 
on information entropy [5], which accounts for the variability - and thus for 
the inherent uncertainty - of the system’s dynamics in phase space. 

In Section 2 the definitions and some characteristic properties of entropy 
production and information entropy are compiled, in parallel with those of 
the principal indicators of dynamical complexity known in the literature such 
as the Lyapunov exponents. In Section 3 a connection between entropy pro- 
duction and dynamical complexity is established for a class of systems giving 
rise to periodic and chaotic oscillations, based on a local analysis in which 
their variabilities across the system’s attractor are identified and compared. 
In Section 4 the parameter dependence of entropy production in a bistable 
system in the presence of fluctuations and of an external periodic forcing is 
considered. The behavior of information entropy of this system is analyzed 
in Section 5. In both cases some well-defined trends are identified. The main 
conclusions are finally summarized in Section 6. 

2 Theoretical Background 

Consider an autonomous dynamical system of n variables Xi , • • • , Xn 

^=f,{{Xj},X) ( 1 ) 

where {/,} are the evolution laws and A the control parameters. We shall be 
interested in macroscopic-level observables such as temperature, bulk veloc- 
ity, or concentrations in a chemically reacting mixture. As well known the 
dynamics of such observables satisfies the dissipativity condition stipulating 
that, on average, phase space volumes are contracting or, in quantitative 
form [2], 



t 1 /■* 

divf =- drdivt {{Xj{T)},\) < 0, t > to (2) 

t Jo 

where f is the velocity field / = (/i, • • • , /„)• In the limit t oo this relation 
becomes 



n 

divf°° = ^ of < 0 (3) 

i=l 

where{d7) are the (mean) Lyapunov exponents measuring the rate of diver- 
gence of nearby trajectories [2,6]. Eq. (3) establishes therefore a link between 
dissipativity and dynamical complexity as reflected by the instability of mo- 
tion occurring when some of the o7’s are positive. On the other hand, dis- 
sipativity is a necessary prerequisite for the application of the formalism of 
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irreversible thermodynamics, in which entropy production occupies a central 
place. In this respect, it seems reasonable to expect a link between entropy 
production and dynamical complexity, which is precisely what is envisioned 
in this work. 

The connection between dynamics and irreversible thermodynamics relies 
on the entropy balance equation [4] 



dS deS „ 
dt dt 



( 4 ) 



where S is the entropy, P the entropy production and dgS/dt the entropy 
flux. While the sign of dgS/dt cannot be prescribed, P must on the contrary 
be a non-negative quantity, vanishing only in the state of equilibrium 



P > 0, Fe, = 0 (5) 

Furthermore, in the range of a local formulation of irreversible processes in 
which S is stil assumed to be a state function of the macroscopic observables, 
it takes the bilinear form 



P = Y,JkXk ( 6 ) 

k 

where are the fluxes of the irreversible processes present and Xk the as- 
sociated thermodynamic forces. 

Given the evolution laws of a dynamical system (eqs (1)) the rate of change 
of entropy, dS/dt, can be formally expressed in terms of ft and the partial 
derivatives of 5 with respect to Xi. In contrast, the entropy production P 
cannot be identified in a unique way as the decomposition in individual fluxes 
requires a more detailed knowledge of the mechanisms participating in the 
dynamics, beyond the global view afforded by eq. (1). This important point 
will be addressed in Sections 3 and 4. 

Suppose now that, in addition to nonequilibrium constraints, the system 
of interest is subjected to stochastic perturbations and to an external periodic 
forcing. To make our main point more transparent suppose, furthermore, 
that the dynamical behavior of interest in the absence of the stochastic and 
periodic disturbances is a supercritical pitchfork bifurcation. When both the 
variance of the noise and the amplitude of the periodic forcing are sufficiently 
weak, the dynamics in the vicinity of the bifurcation is then governed by the 
following normal form [7] 



— — fiz — + F{t) + esinujt (7) 

dt 

where ^ is the order parameter, /i the bifurcation parameter, and the stochas- 
tic perturbation F{t) is/modeled as a Gaussian white noise. 



{Fit))=0,{F{t)Fit')) = q^S{t-t') 



(8) 
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Eq. (7), referred as the Langevin equation, describes a Markov process of 
the diffusion type, whose probability density p{z) satisfies the Fokker-Planck 
equation [2] 



(9) 



dp d 3 , ■ .1 , 

a +£smc.l]p+-^ 

Stochastic formalism has been applied fruitfully to a variety of interesting 
problems by Lutz Schimansky-Geier and his coworkers [8] . It is a pleasure to 
dedicate this contribution to Lutz for his birthday. 

Eqs. (7)-(9) allow one to introduce naturally into the description entropy- 
like quantities of a new type. In the following we shall be interested in the 
Shannon or information entropy [5], 



Si = — J dzp{z,t)\np{z,t) (10) 

on the grounds of its relevance in statistical mechanics and thermodynamics. 
We notice, however, that relative entropies such as the Kullback entropy pro- 
vide also interesting insights in a number of problems related to this work [5]. 

One may derive a balance equation for information entropy, by differ- 
entiating both sides of (10) with respect to time and utilizing eq. (9). We 
obtain 



dSi 

dt 



/ 



dz\np 



— (uz - +e sin Lot)p ■ 

az 



d'^p 



Taking the range of z to be the entire real axis and imposing the boundary 
conditions that p vanishes exponentially fast at ±oo one arrives after some 
straightforward partial integrations at 



dSi 

dt 



{p - 3z^) + 



/: 



dz- 




( 11 ) 



Noticing that the second term is positive definite and comparing with eqs (4)- 
(5) we are led to identify the information entropy flux and the information 
entropy production as [9] 



= (/X - 3z^) = y dz{p-3z^)p 




These expressions will be the starting point of the analysis of Section 5. 
Notice that, contrary to thermodynamic entropy production, the information 
entropy production does not require the decomposition of the dynamics into 
partial fluxes: the global rate of change of the order parameter (here equal 
to pz — z^) is sufficient. 
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3 Entropy Production versus Dynamical Complexity: 

A Case Study 

In this section a local analysis of entropy production versus various indica- 
tors of dynamical complexity is developed. For simplicity we consider low- 
dimensional dynamical systems. Many familiar physical systems obey to in- 
finitely dimensional dynamics, since they are extended in space. They there- 
fore reduce to a finite-dimensional description only when a truncation of the 
infinite hierarchy of the coupled equations for the spatial modes of the field 
variables is carried out. A notable exception are reactive, well-stirred sys- 
tems, which are the only physically implementable systems capable of giving 
rise to periodic and chaotic oscillations in the absence of spatial degrees of 
freedom. 

In the sequel we shall therefore be concerned with the dynamics gener- 
ated by a set of chemical reactions p = 1 , • • • , r involving n species whose 
concentrations we denote by i = 1, Let u)p+,LOp- be the forward 
and backward rates of reaction p, and Uip the number of Xj particles gener- 
ated [uip > 0) or consumed [vip < 0) in the process. The evolution equations 
(1) then take the more specific form 

^ k+({X,}) -a.,-({X,})] (13) 

p=i 

The entropy production associated with this dynamics is a bilinear form 
involving the products of the net fluxes ujp+ —Up- and the associated driving 
forces. In an ideal system the latter can be expressed entirely in terms of the 
rates . Normalizing the entropy production in units of the gas constant 
one then obtains for the local (instantaneous) entropy production 

p = (14) 

On the other hand, to arrive at a characterization of the dynamics gen- 
erated by eq. (13) in phase space one is led to expand around a reference, 
generally time-dependent state {Xj}, 




Writing the formal solution of this equation as 

(5X(t) = L(t) • <5X(0) (15) 

one defines the local (instantaneous) Lyapunov exponents ai{t) as the local 
expansion/contraction rates along a set of orthogonal directions on the attrac- 
tor’s tangent (linearized) space at this particular location. The multiplicative 
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ergodic theorem guarantees that such a decomposition of the tangent space 
is indeed possible. The local Kolmogorov-Sinai entropy will then be the sum 
of the locally positive Lyapunov exponents [6], 

m = ( 16 ) 

<Ti>0 

Several numerical algorithms for computing ai{t) and K{t) starting from the 
evolution equations are available. In what follows we shall use a generalization 
of the algorithm proposed by Eckmann and Ruelle [10]. 

At first sight quantities like eq.(16) seem to be rather remote from entropy 
production [eq. (14)], since they are generated from the Jacobian matrix asso- 
ciated with the rate functions u>p± rather than the rate functions themselves. 
Nevertheless, as we presently argue one may expect some regularities to arise 
in at least the two following situations. 




Fig. 1. Expected dependence of local entropy production versus local Kolmogorov 
entropy for a uniform, circular limit cycle (a), and for a noncircular limit cycle near 
the Hopf bifurcation, (b) or (c). 



3.1 Vicinity of Hopf Bifurcation, Circular Limit Cycle 

Local Kolmogorov entropy is zero throughout a circular limit cycle, since 
there is an everywhere zero tangential Lyapunov exponent associated with 
the uniform rotation along the trajectory, and an everywhere negative one 
associated with the uniform contraction transversally to the limit cycle, which 
is of the order of the distance from bifurcation. lna.P - K diagram, the entire 
span of values of P will therefore lie on the ordinate axis [Fig. 1(a)]. 

In actual fact a typical limit cycle near bifurcation is elliptic rather than 
circular in the ’’original” variables {Xj}. It is only when reduction to normal 
form is made that the trajectory becomes circular in the normal form vari- 
ables. To see how Fig. 1(a) is deformed when going from the normal form 
to the original variables one needs to perform a linear transformation, which 
will locally induce fluctuations of the tangential and normal Lyapunov expo- 
nents. By continuity, one expects that the system will still spend most of its 
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time near AT = 0 states on which one will therefore find the greatest span of 
P values, but there is no longer a guarantee that the largest value of P will 
not occur for some positive K. Some typical possibilities are depicted in Figs. 
l(b)-l(c). Notice that P starts with linear terms in the deviation from the 
unstable steady state and contains, therefore, the fundamental periodicity. 
In contrast, (t, and K relate to phase space distances which are quadratic in 
these deviations. They are thus expected to start with higher harmonics, a 
feature which has been incorporated in drawing Figs. 1(b) and 1(c). 

3.2 Widely Separated Time Scales 

The occurrence of widely separated time scales is a common situation in 
large classes of systems and in chemical kinetics in particular, where rate 
constants and reactant concentrations may span several orders of magnitude. 
More generally, by virtue of Eqs. (2) and (3) it can be argued that dissipativity 
itself arises from the balance between fast contraction (a stabilizing trend) 
and slow expansion (a destablizing trend). 

An interesting manifestation of time scale separation, observed in many 
fields of physical, engineering, and biological sciences, is the occurrence of 
relaxation oscillations. Here a slow, long-lived stage of variation of a relevant 
variable is suddenly interrupted by a fast, short-lived spike of activity, typi- 
cally because a particular step among those present is under the influence of 
positive feedbacks and behaves in an explosive fashion. At the level of eq. (14) 
this should be reflected by the appearance of one large positive term during 
a short time interval, accounting for most of the dissipation over the whole 
cycle. On the other hand, by the very definition of positive feedback, during 
this stage the rate equation of the corresponding variable should contribute 
a strongly positive term locally giving rise to phase space volume expansion 
and to positive Kolmogorov entropy. On these grounds one is entitled to 
expect, momentarily, sharp correlations between thermodynamic dissipation 
and dynamical complexity which may well become diluted when a long time 
averaging over the whole evolution is performed. Very similar arguments ap- 
ply in the presence of chaotic dynamics especially when chaos is in the regime 
of intermittency, characterized by the interruption of long periods of quies- 
cence by sharp peaks of activity. 

The quantitative behavior of local entropy production in parallel with that 
of local Lyapunov exponents and Kolmogorov entropy will now be studied 
on two representative models of periodic and chaotic behavior in chemical 
kinetics. We emphasize that to be amenable to thermodynamic analysis based 
on entropy production a model must be composed of reversible steps obeying 
mass-action kinetics. 
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The reversible Brusselator [11] 

This model comprises two variables X, Y and four initial and final re- 
actants whose concentration is supposed to remain fixed. The reaction steps 
are 



A^X 

X^C 

B+X-F+Y 

2X + Y ^iX (17) 

The Willamowski-Rossler model [12] 

This model comprises three variables X,Y,Z and five initial and final 
reactants whose concentrations are again supposed to remain fixed. The re- 
action steps are 



fci 

Ai + X ^2X 



k-2 

X + Y ^2Y 



kz 

As + Y ^A2 



^4 

X + Z^ A3 

^-4 



k5 

A 4 +Z ^2Z (18) 

*-5 

Figure 2 summarizes our main result for the reversible Brusselator, in the 
regime near the Hopf bifurcation (Fig. 2(a)) realized for low values of the 
concentration b of B, and in the regime of relaxation oscillations (Fig. 2(b)) 
realized for large b. The following points are worth noticing [13]. 

(i) In both cases P spans a wider range of values in the low K (stable) region, 
this tendency being very pronounded in the relaxation oscillation case. 

(ii) The maximal value of P near bifurcation is attained in the high K (most 
unstable) region. This behavior was already anticipated [cf. Fig. 1(b)] 
as being one of the generic possibilities, and arises presumably from the 
markedly noncircular character of the limit cycle. 
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rig. 2. Local entropy production P versus local Kolmogorov entropy K for the 
Brusselator model (eq. (17)) with 6 = 16 (a) and 6 = 60 (b) and all rate constants 
set equal to unity. 



(iii) Far from bifurcation the maximum value of P is attained in the lowif 
(most stable) region. This tendency is very robust, and is already mani- 
fested for b values as low as b = 20. On the other hand, there is a local 
burst of P (though noticeably smaller than Pmax) arising for the highest 
K values, a situation somewhat similar to Fig. 1(c). 

In short, it appears that dissipation attains its maximum variability and, 
most frequently, its maximum value as well at stages during which the dy- 
namics is dominated by stability. 

The dependence of local dissipation P versus local Kolmogorov entropy K 
for the Willamowski-Rdssler model is depicted in Fig. 3. We observe trends 
similar to those in Fig. 2(b) for the reversible Brusselator not very close 
to bifurcation [13]: the widest range of P values, including the largest one 
observed, is in the low K (stable) region, and there is a local dissipation burst 
arising for the highest K values (unstable region). 

In all cases studied and summarized in Figs 2 and 3, the system turned 
out to spend most of its time in the region of near zero local Kolmogorov 
entropies. This property is strongly correlated to the behavior of the velocity 
along the trajectory, the most frequently visited parts being those of low 
velocities. This is clearly seen in Fig. 4, where the time series of the local P, 
K and linear velocity vt are plotted for the Willamowski-Rossler model. 

The existence of a negative correlation between local entropy production 
and dynamical instability established above is in some respects natural. The 
very concept of entropy production rests on the dissipative character of the 
dynamics which implies, in turn, that the overall balance between local sta- 
bility and local instability must be in favor of stability. Alternatively, as the 
system spends most of its time in the stable region (Fig. 4) entropy produc- 
tion has the possibility to develop its maximum span of values in this region. 
In this respect the local dissipation burst is an extreme and thus exceptional 
event. It can be shown that in the models studied the most important contri- 
bution to this burst comes from specific reaction steps which are associated 
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Fig. 3. Dependence of local P versus loced K for the Willamowski-Rossler model 
(eq. (18)) with Ui = 1, fci = 31.2, ki = 1.56, fcs = 10.8, k4 = 1.02, fcs = 16.5, 
k-i = 0.2, k -2 = 0.1, k -3 = 0.12, k -4 = 0.01 and k-^ = 0.5. 




Fig. 4. Upper panel; time evolution of local P and vt, respectively, in full and 
dotted lines (a) and phase plot of P versus vt{b). Lower panel: time evolution of 
local K and vt, respectively, in full and dotted lines (c) and phaise plot of K versus 
vt{d) for the Willamowski-Rossler model. Parameter values as in Fig. 3. 



with positive feedback processes and are the main generators of the dynamical 
instability. 

The analysis outlined in this section has also been carried out on Lorenz’s 
classical model of thermal convection [14], Contrary to the Brusselator and 
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the Willamowski-Rossler models for which the rate equations associated to 
schemes (17) and (18) are exact, a 3-mode truncation of the infinite-dimensio- 
nal Boussinesq equations is now involved. Yet the results are quite similar 
to those of Figs 2 and 3: when plotted against local Kolmogorov entropy the 
viscous and the thermal dissipation present both their maximum variability 
and their maximum value in the stable region. The only difference with Figs 
2 and 3 is that there is now no local dissipation burst at high K values. 
Still, in the light of these remarkably consistent trends, it appears legitimate 
to assert that there are some deep, though not yet fully understood, links 
between thermodynamic dissipation and dynamical complexity. 

4 Dissipation Patterns in a Thermodynamic System 
Giving Rise to Pitchfork Bifurcation and Stochastic 
Resonance 

We turn now to a second, complementary aspect of our analysis, namely, the 
parameter dependence of the full entropy production (rather than its local 
analog along a trajectory) in a system giving rise to multiple steady states 
via a pitchfork bifurcation and subjected, in addition, to a weak noise and a 
weak periodic forcing. 

As seen in Section 2 any system of this kind satisfies a generic evolution 
equation (eq. (7)), whatever the details of the processes involved might be. 
Nevertheless, as stressed also in Section 2 and illustrated further in Section 3, 
to compute the thermodynamic entropy production one needs to have access 
to the fluxes and generalized forces associated to these individual processes. 
For this reason we shall first consider in this section a prototypical system 
for which a full thermodynamic analysis can be carried out. It will be argued 
that many of our conclusions apply to a whole class of physically interesting 
situations. 

We consider the following autocatalytic model [15] 



k\ 

A + 2X^^X 
*2 



k3 

X^B (19) 

*4 

where X denotes the intermediate, and the concentration of the initial and 
final products A, B is supposed to be controlled externally. 

The balance equation for the concentration x of Y is (we limit ourselves 
to an ideal mixture) 



lit O 

— = — /C2 X ki a X — X + b 
at 



( 20 ) 
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Very similar evolution laws hold for biochemical systems, electric circuits, 
charge recombination in semi-conductors and the dynamics of defects in ma- 
terials under stress. 

As well known, a cubic equation like eq. (20) can be unfolded with the 
help of only two parameters, and A. This implies that, upon a suitable 
scaling of x, a, b, and t, it will be sufficient to set from now on [16] 

0 = 3, 6 = 1 - A, k\ = k2 = ki = 1, k^ — k = 3 - fi (21) 

Under these conditions Eq. (20) becomes (we use for simplicity for the scaled 
variables the same notation as for the initial ones) 

dx 

= —3:^ + 33? — (3 — ^l)x -b 1 — A = — (a; — 1)® — A (22) 

Introducing the variable 



z = x-l (23) 

and adopting the following relation between A and fx, 

A = /i 

one can finally cast the balance equation into the canonical form of a cubic 
around a supercritical pitchfork bifurcation, which is nothing but the deter- 
ministic part of the normal form equation (7), 

dz , , ^ 

(“) 

For /i > 0 this equation admits an unstable solution and a pair of two sym- 
metric stable solutions, 



zo = 0 (unstable) 

z± = ±^/J^ (stable) (25) 

One can easily check that the condition ^ > 0 of existence of these latter 
solutions can only be realized if the system is maintained beyond a critical 
distance from the state of equilibrium. 

As well known from irreversible thermodynamics, the entropy production 
of system (19) is the sum of products of the reaction rates times the affinities 
of the individual reactions. Utilizing the expression of the affinities in terms 
of chemical potentials one is led to the following expression [4] 

P = (3x^ - x^) In - 4- {kx - 6) In — (26) 

X 0 

where x, k and b are subjected to (21) and (23). One may evaluate straight- 
forwardly this expression in the stable steady states x± = l + z±. One obtains 
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P± = 21n 



3(3 - fi) 

1- H 






3(3 - m) 

1-H 



(27) 




Fig. 5. Entropy production, eqs (26)-(27), associated to the stable (full lines) and 
unstable (dashed line) states of model (19), as a function of the bifurcation param- 
eter fX. 

Fig. 5 depicts the dependence of the dissipation on the two stable branches 
in terms of the bifurcation parameter /x. We observe that the system dissipates 
more in the upper branch, the asymmetry in the dissipation becoming more 
and more pronounced as /x ^ 1. 

We next switch on the noise and the periodic forcing, transforming eq. 
(24) into the full normal form, eq. (7). The entropy production becomes now 
a stochastic process, P{x), through its dependence on via x. We will be 
interested in the statistical properties of this quantity and, in particular, in 
its mean value 

rOO rOO 

{P{x)) = J dxP{x)p{x) = J dzP{z + P)p{z) (28) 

where p{z) is solution of the Fokker-Planck equation (9). There is an ample 
literature concerned by this solution. As it turns out, a key quantity condi- 
tioning the behavior of p is the kinetic potential [2] 

= + ^ ( 29 ) 

which is just the integral of the deterministic part of the right hand side of 
eq. (7). More specifically, if the potential barrier 
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AU = U{zo) - U(z±) (30) 

is large compared to the noise strenght {AU » 1), the dynamics con- 
sists of long periods of small-scale deviations from z± interrupted by abrupt 
transitions between 2 ;_ and z^. Notice that U is very different from the 
thermodynamic potentials referred to in the Introduction: it is a specifically 
kinetic, non-equilibrium quantity. 

An interesting limit in which the above described dynamics - and es- 
pecially the effect of the weak periodic forcing on it - can be described in a 
transparent way is the adiabatic approximation [2, 3] in which p is represented 
as a weighted sum of local gaussians centered on and z+ , 

p{z,t) = N.{t)4>-{z) + N+{t)cl>+{z) (31) 

with 



= 




r 2p{z-z±)^] 



N^ = ^±SN{t) 

Here SN{t) reflects the presence of the periodic forcing. It can be evaluated 
straightforwardly by linear response theory, the result being [3] 



SN = eA{q, p,, u>) sin(wt + (f>) 

where (p is the phase shift between the response of the system and the external 
forcing and 



A{q,p,oj) 




1 






(32) 



For given p and oj this last expression presents a sharp maximum as a function 
of q, the enhancement becoming more pronounced as ui and p decrease. This 
is the phenomenon of stochastic resonance. 

To see the repercussions of this behavior on entropy production of our 
model (eq. (19)) we substitute (31)-(32) into eq. (28) extending, in agreement 
with the adiabatic approximation, the lower limit of integration over z to — oo. 
One obtains [17] 



(PM) 






+ 



eA{q,p,uj)siii{Lot + (p) (33) 
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where P± and A are given by eqs (27) and (32) and are the second 
derivatives of P± evaluated at z± : 



1 r," o . 3 

-P+ = -Szi In 

2 ^ * l + z± 



+ 



2/r 

\ + z± 



(34) 




Fig. 6. Time evolution of mean entropy production of model (19) under condition 
of stochastic resonance and = 0.2, w = 0.001, e = 0.002. The full and dotted 
lines refer, respectively, to results of numerical solution of the full Fokker-Planck 
equation (9) and of numerical evaluation of the analytic expression (33). 



Fig. 6 (full lines) depicts the time variation of the mean entropy produc- 
tion for a given value ^ = 0.2 of the bifurcation parameter under conditions 
of stochastic resonance and for a forcing e = 0.002, as obtained from a nu- 
merical solution of the full Fokker-Planck equation (9) associated to model 
(19). We observe a dramatic (about 10^ fold) amplification of the effect of 
the forcing, leading to as much as a 30 % local increase of entropy production 
above its mean value. The dotted lines stand for the result of the numerical 
evaluation of the analytic expression (33). The qualitative agreement is good, 
considering the fact that in deriving eq. (33) we applied linear response theory 
despite the considerable enhancement induced by stochastic resonance. 

We close this section by addressing the behavior of entropy production as 
a function of the bifurcation parameter /r, for a fixed value of noise variance 
q^. Since the effect of periodic forcing is negligible outside stochastic reso- 
nance it will be sufficient to consider the time-independent part of {P{x)) or 
alternatively, the time average Poo of (P(x)) over a period of the forcing. 

Fig. 7a depicts the dependence of Poo on /x in a neighborhood covering 
both sides of the bifurcation point /x = 0, obtained by solving the Fokker- 
Planck or Langevin equations (9) and (7) in the absence of the forcing. We 
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Fig. 7. Dependence on the bifurcation parameter of (a) time averaged mean entropy 
(open circles) and mean x (crosses) and (b) their variances for model (19). 



observe a mild, but systematic enhancement as the parameter fi is increased. 
This is fully consistent with Fig. 5 and the idea of noise-induced transitions 
between the two deterministic states: in our system these states are statisti- 
cally equivalent but, on the other hand, the excess dissipation of state z+ (or 
x+) over the reference state z = 0 (or x = 1) is larger in absolute value than 
the dissipation deficit of state 2_ (or x_) over the reference state. Notice the 
absence of critical behavior around ^ = 0, despite the presence of the 
factor in eq. (33). This is due to the fact Pj is of 0(/r) near /i = 0, thereby 
canceling the singularity. 

To assess the role of criticality we plot in Fig. 7b (open circles) the time- 
average of the variance of P(x), S^Poo- The increase is now more pronounced, 
leading to a 4- fold enhancement in the range of variation of fi. For reference, 
we also plot in the same figure (crosses) the /i-dependence of the variance of 
the variable itself. We find a similar pattern, the precritical part of which up 
to a value of |/u| of the order of is well-fitted by the law of critical diver- 
gence [3] ^ characteristic of a Gaussian density p » exp We may 

thus conclude that on approaching the criticality the variability of entropy 
production is considerably enhanced. Notice that in the absence of forcing 
the asymptotic solution of eq. (9) can be evaluated analytically, yielding [2] 



Poo{z) - A * exp 




A being a normalization factor. Both A and the variance of z can be evaluated 
analytical! in the region /i < 0 in terms of the modified Bessel functions of 
the second kind itTi/4 and ^3/4. These results are in quantitative agreement 
with those in Fig. 7b. 



5 Dynamical Complexity and Information Entropy 

In Section 2 it was pointed out that when the dynamics gives rise to a stochas- 
tic process the information (Shannon) entropy, 5/ provides a useful view of 
the system at hand, especially in situations where one does not have access to 
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the individual fluxes of the subprocesses involved. In this section we explore 
the properties of information entropy for the class of systems described by 
eq. (7), using whenever necessary the prototypical model of Section 4 [17]. 

To assess the relative roles of the noise and of the periodic forcing on 
information entropy we use once again linear response theory. To this end we 
substitute in eq. (10) for Sj the expansion of the probability density in terms 
of the forcing amplitude 



p — po + eSp{t) -!-••• 


(35) 


and expand Sj in powers of £ keeping the first non-trivial terms, 
in this way 


One obtains 


Si = Si, 0 + e‘^SSi 


(36) 


with 




fOO 

Si,o = - dzpo In po 


(37a) 


7-00 2po 


(37b) 


These expressions can be further simplified in the adiabatic limit (eq. 
(31)) to 


5/.0 = ln2-f0(g') 

£^6Si = -2SN^ + 0{e-^^'’F 


(38a) 

(38b) 



We see that the unperturbed information entropy reduces, in the weak 
noise limit, to one bit of information - just the amount of information needed 
to localize the system among the two available deterministic steady states 2 _ 
and z+. Note that under the same limit, Si^ would reduce to zero prior to 
the pitchfork bifurcation. This is fully consistent with the underlying physics. 

We next consider SS[. As seen in Section 4, in the presence of stochas- 
tic resonance the amplitude of dN is enhanced dramatically. It follows that 
under conditions of stochastic resonance 6S[ will be a negative number of 
appreciable magnitude. In other words, the information entropy (or equiva- 
lently, the amount of data needed to locate the system in state space) will 
be considerably reduced, as seen in Fig. 8 : stochastic resonance contributes 
here to an enhancement of predictability. This result, also further confirmed 
by the simulation of the full Langevin equation (eq. (7)) and Fokker-Planck 
equation (eq. (9)), as well as the one concerning Si^ are universal, indepen- 
dent of the model at hand: they apply to any dynamical system giving rise 
to pitchfork bifurcation and stochastic resonance. 
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Fig. 8. Time average of information entropy, eqs (36)-(37), associated to model (19) 
as a function of the noise strength q. The minimum corresponds to the optimal value 
of q for which stochastic resonance is realized. Other parameter values as in Fig. 6. 



We turn now to information entropy production. Inserting the expansion 
of eq. (34) into the second relation (12) and expanding in e we obtain 



Pi = Pifi + s^SPi 

with 



(39) 




(40a) 

(40b) 



Using the explicit forms of po and 6p given by eq. (31) one further obtains 



Pip = 2p + 0(g") (41a) 

<5P/ = 0(e-i/«') (41b) 

We see that, despite the presence of the multiplicative factor in (40a) Pjp 
attains a finite value in the iimit q^ 0, depending only on the deterministic 
parameters. This limiting value is actually minus the Lyapunov exponent of 
the system at hand since, according to eqs (2), (3) and (24), 
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= (/i - 3zl) 

= —2fj, 



(42) 



This remarkable result is due to the singular dependence of po on , as seen 
in eq. (31). It can be extended to any dissipative system forced by white 
noise, whatever the regime and the number of variables involved might be, 
provided that the long time limit is taken [9]. It establishes an additional link 
between thermodynamic-like quantities and the quantifiers of the complexity 
of the underlying dynamics. 

As seen from (41b), in contrast to SSj the perturbation SPj induced by 
the forcing becomes negligibly small in the weak noise limit. The informa- 
tion entropy production remains thus essentially invariant under the periodic 
forcing and equal to the value given by eq. (40a) . 



6 Conclusions 

In this essay we outlined a thermodynamic approach to dynamical systems 
giving rise to oscillations, chaotic dynamics and bistability, and explored their 
sensitivity to stochastic perturbations and a weak periodic forcing. This led us 
to identify some clearcut signatures of the dynamical behavior at the level of 
thermodynamic quantities. First, in systems undergoing sustained oscillations 
and chaos, the widest range of dissipation values, including the largest one 
observed, occurs in the most stable attractor regions. Second, while pitchfork 
bifurcation in the absence of periodic forcing is reflected by the creation of 
one bit of information entropy, in the vicinity of stochastic resonance this 
intrinsic uncertainty is substantially lowered, since it now becomes possible 
to predict the attraction basin in which the system will be found with the 
highest probability. Third, the thermodynamic entropy production exhibits a 
great sensitivity toward the periodic forcing, being e.g. considerably lowered 
during certain stages of the evolution. 

An appealing perspective when exploring the thermodynamic dimension, 
is to come up with novel ways to characterize dynamical systems giving rise 
to complex behavior. We have developed here two alternative views along 
these lines, pertaining to the efficiency of a system as a thermal machine and 
as an information processor. Such characterizations are likely to be of value 
in the biological context or in computing devices. 

Our work can be extended to account for other forms of dynamical com- 
plexity and for other forms of stochastic resonance, including aperiodic forc- 
ings and transient response. Of special interest would be spatially extended 
systems, for which our formulation needs to be generalized to account for 
local dissipation and for transport processes within the system. In particular, 
this would allow one to identify the signature at the thermodynamic level 
of such intriguing behaviors as phase synchronization or symmetry-breaking 
and transport in ratchets. 
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Connections between entropy production and phase space volume con- 
traction have recently been explored in the quite different context of the mi- 
croscopic theory of nonequilibrium states [18], It has been argued that when 
subject to thermostatting, microscopic-level dynamics becomes dissipative 
while remaining reversible. The contraction rate is then related to the work 
performed by the nonequilibrium constraints on the system - in turn, equal 
(up to a sign) to entropy production as given by irreversible thermodynam- 
ics. In the present work, the dynamical behavior of interest was associated 
entirely with the macroscopic observables obeying the phenomenological laws 
of continuum mechanics and chemical kinetics, eq. (1). The connection be- 
tween macroscopic and microscopic indicators of dynamical complexity is an 
important problem that certainly deserves attention in the future. 
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Abstract. External fluctuations have a wide variety of constructive effects on the 
dynamical behavior of spatially extended systems, as described by stochastic par- 
tial differential equations. A set of paradigmatic situations exhibiting such effects 
are briefly reviewed in this paper, in an attempt to provide a concise but thorough 
introduction to this active field of rese^irch, and at the same time an overview of 
its current status. This work is dedicated to Lutz Schimansky-Geier on the occas- 
sion of his 50th anniversary. Through the years. Prof. Schimansky-Geier has made 
important contributions to the field of spatiotemporal stochastic dynamics, includ- 
ing seminal investigations in the early 1990’s on noise effects in front propagation, 
and studies of noise-induced phase transitions and noise-sustained structures in 
excitable media, among others. 



1 Introduction 

It is well accepted nowadays that noise can have rather surprising and coun- 
terintuitive effects. There are many physical situations in which noise exhibits 
a constructive, rather than destructive, role in the behavior of a nonlinear sys- 
tem. A relevant example of this fact, still under active research nowadays, is 
the phenomenon of stochastic resonance, in which the response of a nonlin- 
ear system to an external signal under the presence of fluctuations can be 
enhanced by tuning the noise intensity to an optimal (non-zero) value [1]. 
In another direction, studies of stochastic zero-dimensional systems (i.e., sys- 
tems with only temporal dependence), reviewed in [2], showed that noise is 
able to induce transitions in such systems. Spatial degrees of freedom provide 
further interesting scenarios where the non-trivial role of external noise arises, 
such as phase transitions and critical phenomena [3], and pattern formation 
out of equilibrium [4]. 

The present review aims to be a brief introduction to the influence of 
external noise on spatially extended, d-dimensional systems (an extensive 
monograph on the topic can be found in [5]). As far as we know, semi- 
nal works in this direction were already carried out in the late 1970’s by 
Mikhailov [6,7]. Owing to the existence of spatial degrees of freedom, the 
behavior of extended systems is described by phases in a thermodynamic 
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sense. Under these conditions, the presence of certain types of external noise 
affects, in a non-obvious way, the behavior of the corresponding deterministic 
(noiseless) system, or even that of the associated equilibrium system (which 
has internal noise terms obeying a fluctuation-dissipation relation). In par- 
ticular, we expect not only quantitative changes with respect the determin- 
istic results, but also qualitatively different, even new, features induced by 
the presence of external fluctuations. In these situations, naive predictions 
based on a deterministic analysis are very far from giving reliable results. 
Several examples can be enumerated, some of which will be reviewed here: 
noise-induced spatial patterns [8-11], noise-induced ordering phase transi- 
tions (both of second order [12-15], and of first order [16, 17]), noise-induced 
disordering phase transitions [13, 15, 18], noise-induced phase dynamics [19], 
noise-induced fronts [20], and noise-sustained structures in excitable media 
[21-23]. 

Most of the noise-induced phenomena enumerated above act in the direc- 
tion of enhancing the order in the system. This surprising fact contrasts with 
the noise-induced disorder that one could intuitively expect from statistical 
mechanics. In the following pages, we review all these ordering effects. In 
each of the different physical situations, the notion of “order” is defined, the 
mechanisms through which noise produces order are discussed, and a minimal 
model displaying the phenomenon is given. 

2 Noise-Induced Phase Transitions 

The most basic organizing phenomenon in spatially extended systems is the 
transition between two macroscopic phases as a certain control parameter 
is varied. Such phase transitions can be characterized by standard tools 
in Statistical Mechanics, such as scaling functions, critical exponents, and 
renormalization-group transformations [5]. 

From a dynamical perspective, the system can be described in a contin- 
uous way by a coarse-grained field 4>{x,t), representing the local density of 
a relevant physical variable (e.g., magnetization in a magnetic system, or 
relative concentration in a binary alloy). From this viewpoint, a disordered 
phase corresponds to the state 4>{x,t) = 0 (random distribution of up- and 
down-spins in magnetic systems, or homogeneous mixture in alloys), and an 
ordered phase is given by a non-zero field. As we will see in what follows, 
external noise is able to induce phase transitions from disorder to order. We 
consider models obeying a stochastic differential equation of the general form: 

= /(0) + 9(</’) i) -I- -b ^(a;, f ) , (1) 

with X defined in a d-dimensional space. The additive and multiplicative 
gaussian noises have zero mean and correlations: 

{i{x, t)i{x',t')) = 2e 6{x - x') 6{t - t ') , 



(2a) 
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{r]{x,t)r}{x' ,t')) = 2 c{x — x') 5{t — t') , (2b) 

where c{x - x') is the spatial correlation function of the multiplicative noise 
rj{x,t) [c(0) is proportional to the noise intensity]. The white additive noise 
^{x,t) is taken to represent internal fluctuations. 



2.1 A Short-Time Dynamical Instability 

We now review the most common mechanism of noise-induced ordering tran- 
sitions. To do so, we locally analyse the initial evolution of the system. Aver- 
aging (1) with respect to the probability density of the two noise terms, and 
neglecting the diffusive term of the equation: 

(M) = {f (<!>)) + {gW v{x,t )) . (3) 

We now interpret the multiplicative noise T){x,t) in the Stratonovich sense 

[24] . This choice is neither arbitrary nor interested: we simply aim to describe 
realistic fluctuations, temporally correlated but with a very small character- 
istic time. Under this interpretation, the average of the noise term appearing 
in (3) can be computed to be 

{g{4>) 7]{x, t)) = c{0){g{(l>)g'{(l))) , (4) 

where the prime indicates differentiation with respect to the argument [5]. 
Coming back to (3) one can say that, at the initial instants of the evolution, 
fluctuations around the average value of the field (0) can be neglected, so 
that {h{<j))) w h{{4>)) for any function h, and one can write approximately 

dt{^) « fm) + mgimg'im = fe«m) ■ ( 5 ) 

In the zero-dimensional case (no spatial coupling), this approximation is 
strictly valid only at short times. At long times, the system heads towards the 
steady state, in which the noise effect is in fact opposite to that of (5) (see 

[25] ). In the spatially extended case, on the other hand, diffusive coupling 
between neighbors is able to “trap” the system in the short-time dynamics 
given by the effective force /eir in (5). Hence, a simple analysis of the zeroes 
of this function and their stability reveals, in a naive but very efficient way, 
the transition scenario of the system [26]. We will now give some choices of 
/ and g, leading to different noise-induced phase transitions. 



2.2 Noise-Induced Second-Order Phase Transitions 

Let us first consider the following representative model: 

dt(f) = ~(p{l + (f)^) + 4>v{x,t) +V^(j) + ^{x,t), 



(6) 
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which corresponds, in the absence of multiplicative noise, to the well-known 
time-dependent Ginzburg-Landau model, frequently used in studies of critical 
dynamics [3], and whose universality class is that of the Ising model. For the 
deterministic parameters chosen, the system resides in the stable disordered 
state 0(x,t) = 0. In the presence of the multiplicative noise, and according 
to the discussion of the previous paragraphs, the effective force (5) is equal 
to feff{(f>) = [c(0) - \](j) - (f)^, which shows that a non-zero (ordered) value 
of the field can appear for large enough noise intensities (for c(0) > 1 in 
this approximate analysis). This noise-induced ordering phase transition has 
been observed both numerically [12] and theoretically, through linear stabil- 
ity'[9] and mean field [14] analysis. The change of the spatially averaged field 
y f (j){x, t) dx at the bifurcation is continuous, which means that the transi- 
tion is of second order. The system also displays a subsequent phase transition 
back to disorder, also of second order, for larger noise intensities [18]. In spite 
of the non-equilibrium character of the two transitions, a finite-size scaling 
analysis shows that both of them belong to the equilibrium universality class 
of the Ising model [5]. The reason for this can be traced back to the existence 
of the additive-noise term. In its absence (for which the disordered phase 
becomes an absorbing state), a new universality class appears [27]. 

In spite of the simplicity of model (6), most studies performed so far 
on noise-induced phase transitions have been made in a model introduced 
in 1994 by Van den Broeck et al. [13], which has an additional fifth-order 
saturating nonlinearity in the deterministic force, and an external noise with 
both additive and multiplicative contributions: 

= -0(1 4- 4- (1 -|-^2)77(a;,t) -f (7) 

The associated effective force is U«{(t>) = [2c(O)-l]04-2[c(O)-l]0^-0®. This 
system displays again two consecutive noise-induced phase transitions, an or- 
dering and a disordering one, both of which belong to the Ising universality 
class [25] (which is not surprising, since the relevant terms of the determinis- 
tic hamiltonian are the same as those of the Ginzburg-Landau model). The 
observed phenomenology is basically equivalent to that of model (6). In par- 
ticular, for both models the deterministic potential C/det = - / /(0) d0 is 
monostable, so that the system is in all cases disordered in the absence of 
external noise. Moreover, the stochastic potential that can be defined for 
the local dynamics, U^t = ~ - c(O)c/(0)sf'(0)]/[c(O)52(0)] is also 

monostable for all c(0) in the two cases, which indicates that the correspond- 
ing zero-dimensional model does not have a noise-induced transition towards 
order (towards non-zero field) for any of the two systems. 

In its original form, model (7) cannot distinguish between the additive and 
multiplicative contributions of the external fluctuations to the noise-induced 

The stochastic potential Ust{4>) is defined from the steady-state probability den- 
sity Fst(0) of the zero-dimensional system by means of Pst{<p) ~ exp(— 17st) [25]. 
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phenomena. Landa et al. [28] slightly modified the model in order to exam- 
ine the contribution of the additive-noise term, and discovered the existence 
of noise-induced phase transitions (ordering and disordering) controled by 
additive noise, provided a multiplicative-noise noise exists. 

Another similarity between the noise-induced phase transitions exhibited 
by models (6) and (7) is that, in both cases, the mechanism through which 
noise destabilizes the disordered phase is linear, as can be easily seen by 
examining the effective forces in the two situations. A review of linear insta- 
bility mechanisms of noise-induced phase transitions is given in [29]. On the 
other hand, by taking into account the discussion of Sect. 2.1, one can devise 
in a straightforward way models for which a noise-induced ordering phase 
transition is driven by a nonlinear mechanism. The system 

+ <^ 2 ) + 02 ^ ^ ^ 

which has an effective force fe«{<t>) = [2c(0) — 1]0^ — 0®, is an example of this 
fact. In this case, the destabilization of the disordered phase 4>{x,t) = 0 by 
noise is dynamically nonlinear. 

2.3 Noise-Induced First-Order Phase Transitions 

In all previous examples, the 0-d short-time effective force /eff(<^) displays 
a supercritical pitchfork bifurcation controlled by the noise intensity, corre- 
sponding to a continuous (second-order) phase transition when spatial cou- 
pling is taken into account. Suitable choices of and g{(p), on the other 
hand, lead to discontinuous bifurcations in fes{4>), associated to first-order 
noise-induced phase transitions. A first simple example is given by 

dt4> = -(j) + -f -f i{x,t) . (9) 

In this case, the effective force can be seen to be /efr(0) = [c(0) - 1]0-|-0® -0®, 
which displays a subcritical pitchfork bifurcation controlled by noise that cor- 
responds to a first-order phase transition in the spatially extended case. This 
transition is characterized by an abrupt change in the spatially averaged field 
and by a region of bistability between ordered and disordered states. Such 
features were observed by Muller et al. [16] in a model with the determinis- 
tic force of (9) and an external noise with both additive and multiplicative 
contributions. The separate role of additive fluctuations was investigated in 
a modified version of model (7), and a first-order phase transition induced 
by additive noise was found [17], provided multiplicative noise is present. 

The noise-driven discontinuous phase transition displayed by (9) is pro- 
duced by a destabilization of the linear coefficient of the 0-d effective force. 
Similarly to the case of second-order phase transitions, models can be defined 
that exhibit noise-induced first-order phase transitions driven by a nonlinear 
mechanism. The simplest example is: 

dt4> = -0(1 + 0^) -I- (t>'^T}{x,t) + V^0 -1- ^(x,t) , 



( 10 ) 
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for which /eff(<A) = ~(p + 2c(0)^® - This function describes a subcriti- 
cal pitchfork bifurcation at c(0) = 1 in 0-d, and hence a nonlinearly-driven 
discontinuous phase transition can be expected in the spatially extended case. 

All examples presented in the last two Sections have been founded on 
an analysis of the effective force that governs the short-time behavior of 
the zero-dimensional system, which we already argued that would become 
trapped by spatial coupling in the extended case. The conclusions obtained 
by this approach can be confirmed by other methods, such as mean-field 
approximations [30] and numerical simulations of the complete models. 



2.4 Noise-induced Phase Dynamics 

We have just seen that external noise can induce non-equilibrium phase tran- 
sitions, both of first and second order, between two stationary phases. Now 
we aim to analyse the dynamical aspects related to the appearance of a 
non-equilibrium phase in the system. Let us consider a stationary phase, 
in equilibrium or not, with well-defined properties (symmetries). If a control 
parameter, such as temperature, is suddenly changed, the system undergoes 
a dynamical process in order to reach a new steady state corresponding to 
the new value of the control parameter. If the initial and final states belong 
to the same phase, the dynamical process is simple and linear relaxation dy- 
namics can be used to model it. On the other hand, if the final state belongs 
to a phase different from the initial one, then a pattern dynamics appears. 
The pattern is composed of topological defects which evolve towards the new 
steady state. This process is controlled by a small number of parameters, and 
exhibits dynamics of different universality classes, which are well character- 
ized by a dynamical exponent and by the scaling properties of the structure 
function. Two universality classes of particular interest are those of phase 
ordering and phase separation. 

In the following paragraphs, we examine whether external noise can in- 
duce these dynamical processes, and what is the resulting dynamical univer- 
sality class. The answer to the first question is simple: since external noise can 
induce ordering phase transitions, it is also able to induce the corresponding 
dynamics. The second question is much more involved. We can advance that 
the dynamical universality class is not changed, because the physical growth 
mechanisms are the same. 



Noise-induced phase ordering. This dynamics arises in ferromagnetic 
systems, when a sudden decrease in temperature drives the system away 
from a homogeneous state of zero magnetization towards a final state of finite 
magnetization. During this process, the system exhibits magnetic domains, 
some of which grow at the expense of the rest until the whole system presents 
a homogeneous finite magnetization. The characteristic size of these domains 
grows according to the Allen-Cahn law, R{t) ~ t^^^. 
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A representative model of this situation is that defined by (6) . We have 
shown that external noise can induce an ordering phase transition in that 
model. Therefore, beyond the transition point, noise can be considered to 
drive an initially disordered phase into an ordered state, through the forma- 
tion of domains of the two coexisting (positive and negative) ordered phases 
and their subsequent dynamics of competition as in equilibrium models. Nu- 
merical simulations confirm this noise-induced dynamics [31]. Moreover, the 
process has the characteristics of the Allen-Cahn dynamical universality class: 
a clear evidence of the scaling behavior of the structure function with a power 
law ~ is observed. The fact that the universality class is not changed 
can be understood because the driving mechanism of the ordering process is 
the same as in the deterministic case: the local curvature of the interface. 



Noise-induced phase separation. This universality class arises in homo- 
geneous alloys of two atomic species^ initially at high temperature. Following 
a sudden cooling, the two components of the alloy start to segregate, produc- 
ing domains rich in one of the species, whose characteristic size follows the 
Lifshitz-Slyozov law, R{t) ~ The system evolves towards a final state 
consisting on two large domains separated by an interphase. 

A dynamical model of phase separation can be constructed from model 
(6) if mass conservation is imposed. The explicit model reads: 

dt4> = ^'^ {(p + 'p^ -V^(f> + <i>r){x,t)) + V-^(x,t) , (11) 

where ^(x,t) is now a random vector field. This system evolves with the re- 
striction that the spatially averaged field, A J <f,[x,t) dx = (po, is conserved. 
As in the case of model (6), the external multiplicative noise T){x,t) induces 
an ordering phase transition, followed by a disordering one. In the ordered 
region, domains of the two non-zero phases coexist and try to grow. However, 
the dynamics is different from the case of phase ordering. Owing to the con- 
servation law, domains have to grow at the expense of other domains, which 
may be located far away. The driving mechanism is thus diffusion controlled 
by local curvature, as in the deterministic case, and hence we expect the 
same dynamical universality class of Lifshitz-Slyozov. Numerical simulations 
confirm this fact [31]. A scaling behavior of the structure function following 
the power law ~ is observed. 

3 Noise-induced Structures 



Besides phase transitions, a second and very important ordering mechanism 
in spatially extended systems is that of structure formation. The spontaneous 
appearance and sustenance of spatiotemporal patterns is common to many 

Phase separation in fluids is another universality class not discussed here. 
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non-equilibrium extended media, including hydrodinamical, optical, chemical 
and biological systems [4], The system is usually described by a stochastic 
partial differential equation (or a set of them), for which a self-sustained non- 
homogeneous solution is considered to be an ordered state. For instance, in 
the case of a single-field system, an ordered state is represented by a solution 
(j>ix,t) which depends explicitly on x, and which may or may not depend 
on time. We will now review the effects of external noise on several different 
pattern-forming systems. 



3.1 Noise-induced Stationary Patterns 



Let us begin by examining whether noise is able to induce stationary non- 
homogeneous (ordered) states in a pattern-forming system. The standard 
model displaying such a phenomenology is: 

dt(f) = -t- <A^) 4- - (V^ -h klf <t> + ^{x,t) , (12) 



which corresponds to the well-known Swift-Hohenberg model, widely used to 
describe the formation of stationary structures in hydrodynamics and nonlin- 
ear optics, among other fields. For the parameter region chosen, the stationary 
solution of (12) in the absence of multiplicative noise is the disordered state 
^{x,t) = 0. When the external fluctuations are considered, the homogeneous 
solution becomes unstable, as can be seen in a simple way from a linear sta- 
bility analysis of the first statistical moment of <f>. To that end, we linearise 
(12), transform it to Fourier space and average the resulting equation with 
respect to both noise distributions, which leads to: 



dt{<P) = 



c(0)-l - {<P}- 



(13) 



This analysis shows that the disordered phase (p{x,t) = 0 becomes unstable 
at c(0) = 1 for a non-zero wavenumber fco, corresponding to the appearance of 
a periodic pattern of wavelength 27r/A:o. A similar conclusion, at least at first 
order in noise intensity, can be observed when the stability of higher-order 
statistical moments is analysed^. 

The model of Van den Broeck et al. [13] with the addition of a Swift- 
Hohenberg-like spatial coupling term has also been examined in search of 
noise-induced patterns. They have been observed coming from multiplicative 
[10] and additive [11] noise. 



3.2 Noise- induced Propagation 

The simplest non-stationary phenomenon in a spatially extended system is 
the propagation with constant velocity of a structure through the system. 
We will see in what follows that external noise is also able to induce such an 
ordering effect. 

® This fact contrasts with the case of 0-d systems, where statistical moments of 
different order have different instability thresholds at all orders [32]. 
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Noise-induced fronts. A front is a spatiotemporal structure linking two 
different homogeneous states (kink). Experiments have shown that noise sup- 
ports front propagation in a chain of bistable diode resonators [33]. We now 
examine the effect of multiplicative noise on the one-dimensional propagation 
of a front in the following field equation; 



d(b d^<b , „ 



(14) 



In the absence of noise, the homogeneous phase (p{x, f) = 0 is the only stable 
state of the system. Neither fronts nor any kind of spatial structure can be 
sustained at large times; any initial condition <^(a;, 0) ^ 0 decays rapidly to 
the above-mentioned disordered state. In the presence of noise, a systematic 
contribution to the deterministic dynamics arises as shown in Sect. 2.1. One 
can therefore write an effective model that has the same behavior as (14) on 
average: 

d(b d^d) , 

~ '^(1 “ c(0) + ^^) + ^eff(a:,t) , (15) 

where the effective noise has zero mean. According to this equa- 

tion, the homogeneous zero state becomes unstable for c(0) > 1. Under this 
condition, an initial localised perturbation prod uces a ki nk-antikink pattern 
that propagates until a non-zero state (f>gf ~ i/c(0) - 1 invades all the sys- 
tem. T he mean velocity of the propagating front can be computed to be 
V = c(0) — 1. These analytical predictions can be confirmed by numerical 

simulations of the exact model [20]. 



Noise-sustained signal propagation. Propagating kink-antikink combi- 
nations behave as a train of traveling pulses that can act as information bits in 
a communication system. In a chain of asymmetrical double- well oscillators, 
these pulses are intrinsically unstable in the absence of noise. Multiplicative 
noise is able to sustain propagation of these pulses, as can be understood in 
a simple way by analysing the following model: 



dt 



= (j){l-(f))[^-a) + D^~+v^+(i)'q{x,t). (16) 



This equation contains a diffusive and a convective term in order to model a 
uni-directional coupling in this one-dimensional system. For 1/2 < o < 1, the 
deterministic potential is an asymmetric double well, with <f> = Q more stable 
than ^ = 1 (which are the two fixed points of the system). Therefore, in the 
absence of noise a kink-antikink pulse shrinks and decays as it propagates. 
Noise is able to prevent this decay, as can be seen by writing an effective 
model with a zero-mean noise, as has been made in the previous section. It 
is easy to see that an optimal value of noise intensity renders the effective 
potential of this model symmetric [34], which allows sustained propagation 
of pulses through the system. 
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3.3 Noise-supported Structures in Excitable Media 

Due to their special characteristics, excitable systems are especially sensi- 
tive to noise. Perturbations due to noise are able, for instance, to make 
the system jump from the rest to the excited state. But besides nucleat- 
ing excitation pulses, external noise can also sustain their propagation in the 
subexcitable regime (in which such motion would not be possible under de- 
terministic conditions). This fact has been observed numerically for the case 
of spiral waves [21], in what provided the first example, up to our knowledge, 
of spatio-temporal stochastic resonance. Additionally, chemical subexcitable 
media have also provided the first experimental evidence of noise-sustained 
pulse propagation [22]. Such constructive effects of noise can be modeled by 
cellular automata [23]; the obtained results lead also to predictions of noise- 
induced synchronization and global oscillations. Another possible modeling 
procedure is by means of continuous FitzHugh-Nagumo models of excitable 
media. Analyses in this direction have shown that external multiplicative 
noise is able to support spiral turbulent states in simple activator-inhibitor 
models [35], and that additive noise induces synchronization phenomena [36]. 

3.4 Other Constructive Effects of Noise 

There are several other examples of noise-induced order in extended me- 
dia that have not been described in the previous pages. We have already 
briefly mentioned the phenomenon of spatiotemporal stochastic resonance 
in excitable media [21]. In that case, a certain non-zero but finite value of 
noise intensity exists for which the propagation of excitation waves is op- 
timbal. The extension to spatially extended systems of the phenomenon of 
stochastic resonance can be understood in other ways. In its purest interpre- 
tation, it corresponds to the enhanced response of a spatially bistable system 
(i.e., whose Lyapunov functional has two minima corresponding to two stable 
spatiotemporal states) to a harmonic signal [37]. 

Another constructive effect of noise, in this case not as counterintuitive, 
is the sustenance of drifting structures is systems with a convection term 
[38,39]. In this case, structures would escape through the system boundaries, 
swept by convection, in the absence of noise. Fluctuations ensure a continuous 
creation of structures, which are therefore sustained by noise. 

Noise has also been seen to have a constructive influence in globally cou- 
pled systems. As an example, a model of interacting Brownian particles in a 
periodic potential has been recently found to exhibit a noise-induced phase 
transition [40] , in which the ordered phase can be interpreted as a ratchet-like 
transport mechanism, even though the underlying potential is symmetric. 

4 Conclusions 

We have tried to review, in a clear and pedagogical way, the ordering influ- 
ence that external noise exerts in the spatiotemporal dynamics of extended 
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media. Two main topics have been considered, namely noise-induced phase 
transitions and noise-induced structure formation. In each situation, a specific 
notion of order has been introduced. In the case of phase transitions, order 
is understood in a coarse-graining sense, so that it corresponds to a non-zero 
(even uniform) field. In the case of pattern formation, order is defined in 
opposition to uniformity, so that it corresponds to a non-uniform field pro- 
file, either depending or not on time. In any of the two cases, external noise 
can be seen to induce order. In each particular situation, the ordered phase 
can be characterised by standard tools used in the corresponding determinis- 
tic (or equilibrium) phenomenology. We interpret multiplicative noise in the 
Stratonovich sense, impelled by a search of realistic modeling of the fiuctu- 
ations. Phase transitions induced by multiplicative noise in the Ito interpre- 
tation have been recently found [41], but they have a disordering character. 
Finally, we should also note that all the phenomena reviewed here can be ex- 
plained by the short-time dynamical instability mechanism described in Sect. 
2.1. But ordering transitions exist that are driven by a different mechanism, 
an investigation of which is currently in progress [42]. 
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Abstract. We review the role of linear instabilities on phase transition processes 
induced by external spatiotemporal noise. In particular, we present a detailed linear 
stability analysis of a standard Ginzburg-Landau model with multiplicative noise. 
The results show the well-known constructive role of fluctuations in this case. The 
analysis is performed for both non-conserved and conserved dynamics, correspond- 
ing to order-disorder and phase separation transitions, respectively. 



1 Introduction 

Among all counterintuitive influence that external noise can exert on dynam- 
ical systems, spatial ordering has received a special attention in last years. 
Noise-induced patterns, for instance, have been observed in Swift-Hohenberg 
models in the presence of external fluctuations [1-3]. The mechanism through 
which the pattern-forming instability arises is linear, and the role of noise 
(which as an external noise has to be interpreted in the Stratonovich sense) 
is to renormalize the coefficients of the corresponding dispersion relation [4, 5]. 
Subsequent investigations showed the existence of noise-induced phase tran- 
sitions in field models^ [6)7], some of which were attributed to a short-time 
instability that survives through observable time scales due to entrainment 
caused by spatial coupling [8]. However, it can also be shown in these cases 
that the mechanism through which noise destabilizes the disordered phase is 
again linear [9, 10]. In the following pages, we review in detail the infiuence 
of multiplicative noise in the linear destabilization of a homogeneous phase, 
which leads to the appearance of a noise-induced phase transition. This linear 
instability mechanism is not unique, since in some cases the destabilization 
is driven by a nonlinear mechanism [11], Nevertheless, those situations are 
still a minority, and will not be considered in the following. 

^ Throughout this paper, we use the term “phase transition” in the statistical- 
mechanics sense, to denote transitions between macroscopic states that display 
universal properties in the thermodynamic limit. 
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The stability analysis will be performed for two kinds of dynamics, the 
first of which is a standard relaxational model that evolves towards one of 
two phases (ordered or disordered) with no restriction. In the second case, the 
dynamics is restricted by a conservation law of the spatially averaged field, 
which leads in the ordered state to a process of phase separation. Whereas 
the linear stability analysis of the former, non-conserved systems is so far 
well known [4], that of the conserved case is introduced here in more detail. 

2 Linear Stability Analysis 

Transitions between two macroscopic phases in a given system occur due to 
the loss of stability of the initial state for certain values of the control pa- 
rameters. It is well known nowadays that some types of noise can modify the 
stability of a state, and thus change the parameter values at which the tran- 
sition takes place (i.e. the transition point). In many cases, the mechanism 
through which the destabilization arises is linear, and therefore the location 
of the corresponding transition point can be found by means of a linear sta- 
bility analysis. This analysis consists on studying the dynamical behavior of a 
perturbation applied initially to the state whose stability is being examined. 
In a linear approximation, valid only at short times, these perturbations ei- 
ther grow or decay exponentially in time. In the first case the initial state is 
unstable, in the second one it is stable. 

In the case of stochastic systems, the linear stability analysis needs to 
be performed on a statistical moment of the pertubed state. Contrarily to 
homogeneous (zero-dimensional) systems, the onset of instability for spa- 
tially extended systems is the same for all statistical moments (at least when 
moded-coupling contributions are discarded) [5]. It is especially interesting 
in this case to perform the analysis on the structure function, since this 
quantity (which is the Fourier transform of the second statistical moment) is 
proportional to the intensity of scattered light in X-ray and neutron diffrac- 
tion experiments. Moreover, for conserved systems (whose first moment is 
constant in time) we are forced to study the second statistical moment (or a 
higher-order one) . 

We will now perform the linear stability analysis of the structure function 
for the particular case of models A and B (using the terminology of criti- 
cal dynamics [12]) with spatiotemporal multiplicative noise. Model A is the 
prototype of a non-conserved system, model B of a conserved one. 

2.1 Model A 



This nonconserved model is defined by 



d<l>{r,t) 



= -a(j) - -h DV'^4> -b (p^{r,t) + T]{r,t ) , 



dt 



( 1 ) 
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where both additive and multiplicative noises are Gaussian with zero mean 
and correlations 



(r/(r, t)r}(r',t')) — 2e5{r- r') 5{t - t') (2a) 

t) t')) = c{\r - r'|) d{t - t') , (2b) 

and £ and are the additive and multiplicative noise intensities, respectively. 
The function c(|r — r'|) is the spatial correlation function of the external 
noise, which becomes 6{r - r') in the limit of zero correlation length. This 
external multiplicative noise can be understood as fluctuations in the control 
parameter o. 

The linear stability analysis is performed in a discrete version of the 
model. In a d-dimensional discrete lattice of mesh size Ax, (1) takes the 
form: 

— —o, (pi — (j>i +D ^ ^ Dij (j>j + Tii{t) + (pi ^i{t) , (3) 

3 

where (pi = (p{ri), ri = Axi, i € [0, L — 1]^ and L is the number of cells 
on each side of the regular lattice. The sum runs over the whole lattice, and 
only one index is used to label all cells, independently of the dimension of 
the system. Dij accounts for the discretized Laplacian operator 

^ ^ ~ 2dSij) , (4) 

3 3 

where nn(i) represents the set of all sites which are nearest neighbors of cell 
i. The discrete noises T]i(t) and ^i(t) are still Gaussian with zero mean and 
correlations 

(r}i(t)T]j(t')) = 2e^6(t -t') (5a) 

(^i (t) 0 (i')> = 2 <7^ (5b) 

where C|j_j| is a convenient discretization of the function c(|r - r'|), which 
in the limit of zero correlation length becomes bijjAx'^. 

In order to study the stability of the homogeneous state {(pi{t) =0 Vi), we 
linearize (3) and look for the dynamical equation of the two point correlation 
function {(pi(pj): 

= -2a{(pi4>j) + D'Y^(^Dis{(p,(pj) + Djs{(ps(pi)'j + 

S 

+{^i<Pi<Pj) + i^j(pj<pi) + Mj) + {Vj<Pi)- (6) 

The last four terms of this equation can be calculated with the help of 
Novikov’s theorem [13], which in our case takes the forms: 

{mmm) = E/ 



(7a) 
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ivimm = Y.f dt'{viit)vs{t')) 

s 

Now, by formally integrating the linear terms of (3), 



4>i{t) = (Ai(O) + f dt' \ +DJ2 Dij Ut'] 

Jo 



we can calculate the response functions at equal times 



6(i>i{t) 



— (f) ^is 1 



6<pi{t) 



Making use of these expressions, (7a) and (7b) become 

(^i(i)</'t(f)<?i'j(*)) = +^jMs4>i)) 

s 

— O' {J*i4*j) (oo + 0|i_j|) 



For the second statistical moment we thus have 

= -'Ja{4>i4>j) + D'^{Dis{4>s<t>j) + Djs{4>s(j>i)^ + 

8 

+2(7^ (c|i_j| + Co) + 2^^ Sij . (11) 

The structure function can be defined as 

I (12) 

where <p^{t) = 4>{kfi,t) is the Fourier transform of (j>i{t) 
i ^ ^ 

with kf^ = and /x G [0,L - 1]“*. From definitions (13) the following 

relations can be easily verified 

= L%j . (14) 

M * 

By using definition (13) we can write the dynamical equation for the 
structure function as 
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and substituing (11) 

' ^ ifjiS 

+2a^CoS^{t) + 2a^ + 2e. (16) 

^ i.j 

Now we have to rewrite the Laplacian terms. A Fourier-transformed Lapla- 
cian operator does not couple variables with different moment. In fact, it can 
be seen that the Laplacian term leads to 

- D^S,{t) , (17) 

where the following relation has been taken into account 

a ^ * v^p 

and (S|i|=i cos(fc^ ■ rj) — 1^ can be understood as the Fourier 

transform of the discrete Laplacian. On the other hand, using definition (13) 
and relations (14), the last contribution of the multiplicative noise in (16) 
can be written as 

2”’ = "’(liaiE ■ (>2) 

^ ' i,j ^ 

Therefore, taking into account (17) and (19), the equation for the structure 
function becomes finally 

= -2u^ S^{t) + 2e + 2a^ Y > (20) 

with the additional dispersion relation = a — co — DD^ . In the con- 
tinuous and thermodynamic limit {Ax 0 and L —¥ oo), the dynamical 
equation for the structure function is 

^^^ = -2u{k)S{k,t) + 2e + 2-^ ldk'c{\k-k'\)S{k',t) (21) 

with 

oj{k) = a — (7^ c(0) + Dk^ (22) 

Looking at this dispersion relation, it is readily seen that perturbations grow 
when oj{k) < 0 for some interval of k values. Hence, the homogeneous state 
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(j){r^ i) = 0 is stable if uj{k) > 0 V fc. This is satisfied for a — c(0) > 0 and 

thus we can define an effective control parameter 

cieff = a — c(0) (23) 



such that for OefF > 0, the homogeneous state <p{r,t) = 0 is stable. The 
transition point is then 

at = c(0) , (24) 

which in discrete space is written as «( = ct^cq. This transition point in- 
creases with noise intensity and decreases with noise correlation length be- 
cause c(0) ~ In the deterministic case (cr^ = 0 and s = 0) at = 0 
and thus, for a > 0 the disordered homogeneous state <j)(r,t) = 0 is stable, 
whereas for a < 0 this disordered state is unstable. In the presence of multi- 
plicative noise at = c(0) > 0, and hence the homogeneous disordered state 

is stable for a smaller region of the control parameter than in the determin- 
istic case. Hence, fluctuations in the control parameter induce order in the 
system. 

There are other techniques that allow us to find the onset of instability. 
One of them is the study of the stationary state of the structure function 
equation given by the linear stability analysis [see (21)]. In contrast with the 
above discussion, this method takes into account the mode-coupling term 
which depends also on the multiplicative noise. For the particular case of 
multiplicative noise white in space [c(|A: — fc'|) = 1], the steady state for the 
structure function can be obtained firom (21) 

S,t{k) = ^[e + a^Gst{0)] (25) 



where Gst{r) = f Sst{k) is the correlation function. By inte- 

grating again the above equation, we find that the value Gst(O) is 



Gst(O) = 



£■7 

1 — (T^7 ’ 



1 r dk 

[2t:Y J <^{k) ’ 



(26) 



Hence, the resulting stationary structure function is 



Sstik) = 



g' 

oj(k) ’ 



1 — ’ 



(27) 



where g' is a renormalized additive noise intensity. In the subcritical region, 
where nonlinear terms are supposed to be negligible, it is expected that this 
linear result agrees satisfactorily with the behavior of the full nonlinear model. 
Nevertheless this stationary solution will diverge for = 1, which indicates 
that at that point the result is not valid anymore. Hence, the value of the 
control parameter at which the stationary structure function diverges is the 
transition point a = at- The condition = 1 explicitly reads. 
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which is the same as the one found by Becker and Kramer [4]. It is possible 
to see that the contribution of the mode-coupling term [last term in (21)] to 
the transition point is quite small (of order ^ in d = 1). Other methods such 
as mean-field approximations also give corrections to the transition point of 
order 



2.2 Model B 

The conserved model corresponding to the one studied in the previous Section 
is defined by 

[a4> + 4? + 4>i{r, t)] + r,(r , t) , (29) 

where represents, for instance, the local difference of concentrations 

of each phase in the case of a binary alloy. Multiplicative noise represents 
fluctuations in the control parameter a. Both additive and multiplicative 
noises are Gaussian, with zero mean and a correlation for the additive noise 
given by 

{rj{r,t)r]{r',t')) = -2eV^S{r - r’)6{t - t') (30) 

and (2b) for multiplicative noise. The discrete version of the model in a d- 
dimensional lattice of mesh size Ax is: 



cl(pi 

dt 






a(f>s + <f>l +4>s^s{t) 

J 



+ Vi{i) , 



(31) 



where 4>i = 4>{ri), as before. The discrete noises r)i{t) and ^i(t) are still 
Gaussian, with zero mean and correlations given by 



(r]i(t)rjj(t')) = -2e^d(t-t') (32) 

and (5b). 

As done in the previous Section, we will study the stability of 4>i(t) =0 Vi, 
taking only into account the linear terms in (31). In this case, the dynamical 
equation for the two-point correlation function {<l>i(f>j) is 






o(0j-^s) Dstn{^m4>j) + {4'j4‘sis) 









-a{4As)-DY,D sm(0m T {4'i4^s^s} 






Novikov’s theorem allows us to calculate all noise terms in the previous equa- 
tion. The procedure is the same as before [see (7a)-(10b)j and the results 
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are 



{(f>j(ps^s) — ^sm ^\s—m\{^m^j) ^ ^ ^ ^jm^\ s—m \{4> m 4>s) (34a) 

m m 

eDii 



{4>i4>j) = '^Di. 



(34b) 



a{4>j4>s) - Py^.D sm 



Hence, for the second statistical moment we have 
dt 



m^s) 






Cl{(pifps) P ^ P sm{4^m4^i) 



+a^ E 



2=1? ■ (25) 



We now look for the equation of the structure function. Substituing (35) into 
(15) and considering relations (14) and (18), we finally find 



dt 



= 2D^ 



a - D^{D - (T^Ci) +cr^y2 ^OmCn 



s^{t) 



+2a^ (Z\a;L)-‘'^c^_^5^(f) -2e5^ 



(36) 



In the continuous and thermodynamic limit, we have 
g^Ofc ^ t) ^_2k'^uj{k) S{k, t) + 2s k^- 2 j dk'c{\k 

with the dispersion relation 

ui{k) = a + a^ [^^c(|r|)]^^Q + (Z) - cr^ c(0)) k'^ 
In discrete space, this relation reads 



fc'|)5(fe',f) 

(37) 

(38) 



W/[/ = a + 2 da^{ci - co) - [D - Ci)5^ . 



(39) 



The dispersion relation indicates that for w(fc) > 0 V A;, the homogeneous 
null state is stable. This occurs for a + cr^ [V^ c(|t’|)]^_p > 0 so that, as in 
the previous Section, we can define an effective control parameter 

tteff = a + <7^ [V^ c(|r|)] , (40) 

such that the homogeneous null state is stable for positive values of Oeff. 
Hence, the onset of stability is now given by 

= -0-2 [V^cdrDj^^Q , (41) 
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which in a discrete space is written as 

at = 2d(T^{co - Cl) . (42) 

As in model A, the transition point in the presence of multiplicative noise 
is positive and therefore, fluctuations in the control parameter induce or- 
der in the system. However, the effective control parameter is different be- 
tween the two models. In model A, the dependence of the transition point 
on the spatial correlation of the noise is merely due to a natural “soften- 
ing” effect of noise correlation [when the noise is spatially correlated, its 
effective intensity is cr^c(O) ~ er^ In model B, the Laplace operator 
introduces a more complicated dependence on the spatial correlation of the 
noise, at ~ Moreover, the expression of oj{k) for model B (38) has 

a noise dependence term that can be considered as a modification of the spa- 
tial coupling parameter D. We can thus define an effective spatial coupling 
parameter Deff = D — a^ c(0). These results are consistent with those coming 
from a mean-field approximation in the limit of infinite coupling [14]. 

As it has been done in the previous Section, we can look for the stationary 
state of the structure function and find a condition for the onset of instability 
which takes into account, in contrast with the above discussion, the coupling 
term between Fourier modes. For the case of multiplicative noise white both 
in time and space (c(|fc — A:'|) = 1), the stationary structure function is 



~ oj(k) ’ 

with e' given by expressions (27) and (26). This solution diflfers from that 
corresponding to model A in the expression of u>{k) [compare (22) and (38)]. 
The transition point is given by = 1, for which the stationary structure 
function diverges, and is equal at first order to the result given in (41). 

For the particular case of a spatial correlation cdrl) of gaussian type 



whose width A characterizes the correlation length of the noise, and which 
becomes a delta function for A -> 0, the transition points for models A and 
B are, respectively, [see (24) and (41)] 



a 



A 

t 



^2n)d/2 xd ’ 



da^ 

{2Ti)d/2 \d+2 ■ 



(45) 



3 Conclusions 

Noise-induced phase transitions for which linear destabilization is the domi- 
nant mechanism have been examined in detail by means of a linear stability 
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analysis. The study is performed on both non-conserved and conserved mod- 
els. In the two cases, noise is seen to have an ordering effect in the system, 
although the influence is seen to be different in each situation. The role of 
spatial correlation of the noise is somewhat simple in the non-conserved case, 
but clearly non-trivial in the conserved model. 
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Abstract. The phenomenon of parametric resonance is revisited. Several physical 
examples are reviewed and an exactly solvable model is discussed. A mean field 
theory is presented for globally coupled parametric oscillators with randomly dis- 
tributed phases. A new type of collective instability appears, which is similar in 
nature to that of noise induced phase transitions. 



1 Introduction 

Parametric resonance refers to the instability of a system in response to the 
time-periodic modulation of one of its parameters. The simplest and best 
studied example is the parametric harmonic oscillator: 

X -b u)^{t)x = 0 (1) 

in which the eigenfrequency u{t) changes in a time-periodic fashion: 

u‘^{t) = will + fit)] (2) 

where f{t) is a periodic function of time, f{t) = f{t + T), with Up = 2-k/T 
the frequency of the perturbation. One of the trademarks of parametric reso- 
nance is that the most pronounced instability is induced by a superharmonic 
perturbation with frequency ojp « 2wo- For the harmonic oscillator, one ob- 
serves, in absence of saturating nonlinear terms, an unlimited growth in the 
amplitude. 

We will discuss in more detail how the oscillator extracts energy from the 
perturbation in section 3. In view of the ubiquity of harmonic oscillators in 
physics, one expects that parametric resonance also occurs in a wide variety 
of physical systems. Some salient examples of parametric resonance in phys- 
ical systems are reviewed in section 2. In section 4, we will study coupled 
parametric oscillators, and the connection to noise induced phase transitions 
is discussed in section 5. 

2 Physical Examples 

The oldest example of parametric resonance is the parametrically driven pen- 
dulum. As it is well known, the eigenfrequency for small oscillations around 
the vertical resting position is given by wq = -\/^, where g is the gravita- 
tional constant and 1 the length of the pendulum. It is thus clear that the 
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eigenfrequency can be perturbed in two ways. We first turn to a periodic 
modulation of the length of the pendulum. The discovery of this form of 
parametric resonance dates back to way before the birth of Newtonian me- 
chanics, and was practised in the cathedral of Santiago de Compostela in the 
early Middle Ages. One can guess the concern of the local bishop to make his 
church smell fresh with incense, while a non-abiding flux of pilgrims, walking 
all the way South from as far as Germany and Holland, was daily streaming 
in to pay their respect to Saint James the Major’s remains. A giant censor, 
called O Botafumeiro, and weighing about 60 kg, was hanging from a rope 
that passed through a roller at the ceiling, 20 m high. By pulling and re- 
leasing this rope (A/ w 1,5m) periodically, with 5 strong men at the task 
and orchestrated by the initiated priest, the censor could be pumped in 17 
cycles to a full swing, nearly touching the ceiling of the cathedral, and hap- 
pily releasing its beatifying odor as it passed at about 50 km/h 1.5 meter 
above the floor. This remarkable and spectacular physical phenomenon is re- 
ported and described in a medieval manuscript, as an addendum to the true 
story, namely the fact that the very same rope of the censor was used for the 
hanging of the local archbishop on June 29, 1366. It should be noted that 
the physics of the pendulum with time-periodic length is more complicated 
than that of (1), because the time derivative of the impulse p = d{W)fdt 
will generate a time dependent friction term. For a detailed treatment in- 
cluding the nonlinear terms, as well as a comparison with the experimental 
observation in Santiago de Compostela, see [1]. The other way to vary the 
eigenfrequency of the pendulum is to modulate the gravitational constant. We 
know from Einstein’s general relativity that gravitation is locally equivalent 
to an accelerated frame of reference. By modulating the acceleration, one can 
modulate the gravitational constant. This can be realized for the pendulum 
by periodically varying its suspension point. For a frequency u!p w 2o;o (and 
low friction), one observes that the oscillating suspension point will induce, 
above a critical amplitude, a bifurcation to an amplified swinging motion of 
the pendulum around its equilibrium position. One can easily perform the 
test oneself by hanging, for example, a cup from a rope and moving one’s 
hand up and down at twice the oscillation frequency of the pendulum. For a 
nicely documented computer experiment, see [2]. 

In 1831, Faraday discovered that a layer of fluid can develop surface rip- 
ples when the basin that holds it is periodically moved up and down. The 
Faraday instability is another example of parametric instability. The surface 
of the water can be considered as consisting of an infinite number of harmonic 
oscillators, namely all the surface eigenmodes. In the case of so-called gravity 
waves (deep water neglecting dissipation and surface tension), the dispersion 
relation expressing the frequency a;o(A:) of these waves as a function of their 
wave vector k = 2 tt/X is particularly simple [3] and very similar to that of 
the pendulum, namely u!o{k) = v^- Incidentally note that these waves are 
highly dispersive with the phase velocity cJo{k)/k twice as large as the group 
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velocity dbJo{k)/dk. By periodically vibrating with frequency ujp the whole 
basin containing the fluid, one is in fact periodically changing g. By paramet- 
ric resonance, surface waves with frequency uq « Wp/2 will be most strongly 
excited. 

It is impossible to trap charged particles in vacuum by a stationary elec- 
tric field. Indeed, divE = 0 implies that the electric streamlines behave like 
an incompressible fluid with no possibility for sinks to trap the particles. But 
trapping is possible for time-dependent electric fields or in combination with 
magnetic fields. The schematic set-up of the Paul trap is represented in fig.l. 
It consists of a set of electrodes, one of parabolic and the other of hyperbolic 
shape. For a given static potential difference between both electrodes, the 



Z 




Fig. 1. The schematic representation of a Paul trap 



force acting on a charge in the center of the apparatus and along the axis of 
symmetry is very close to harmonic. Modulating the potential thus induces 
parametric resonance as described by (1). Note that in this system 
takes on periodically a negative value, since the electric potential will always 
have the form of a saddle with one stable and one unstable direction. By 
appropriately tuning the parameters, charged particles can however be sta- 
bilized in the center, as we will explain in the next section. The Penning trap 
confines the particles in one direction by an appropriate steady electric field, 
combined with a strong magnetic field preventing escape in the orthogonal 
direction. This trap has been used to demonstrate parametric resonance for 
an ensemble of electrons located in the trap. The eigenfrequency ujq is of the 
order of 100 MHz and the electrons can be parametrically excited to leave 
the trap by a perturbation of the applied electric potential at radio frequency 
Wp « 2ujo [4]. 

Maybe the most dramatic illustration of parametric resonance is the dy- 
namical Casimir effect. The Casimir effect was first predicted in 1948 [5]. 
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Casimir showed that two (perfectly) conducting plates in vacuum are sub- 
jected to an attractive force given by 



he S 

240# 



( 3 ) 



where h is the reduced Planck constant, c the velocity of light, S the surface of 
the plates and d the distance between them. The origin of the force goes back 
to the vacuum fluctuations of the electromagnetic field. In view of quantum 
uncertainty, the electromagnetic field can not be perfectly quiescent, even 
in its ground state. These ground state excitations, the virtual photons, can 
however not exist in all possible wavelengths in between the plates, since 
the wavefunction must be exactly zero on the plates. The lowest possible 
frequency for these virtual photons is thus loq = 27tc/A = Trcjd. Since the 
virtual photons exert a pressure on the plates, and since all wavelengths are 
excited outside but not between the plates, a net force results. Another way 
to state this observation is that the energy density is lower between the plates 
than outside. The work done by the Casimir force upon separating the plates 
corresponds exactly to the energy deficit between inside and outside. The 
Casimir force also appears in other configurations (e.g., plate with sphere or 
two spheres) . Only recently has it been observed and measured and found to 
be in agreement with the Casimir formula (3) [6]. 

From the relation cjq = 7rc/d it is clear that a periodic modulation of 
the distance d corresponds to a parametric pumping of the modes between 
the f)lates. It is called the dynamical Casimir effect. The amplitude insta- 
bility that one classically observes corresponds to the creation of photons in 
a quantum mechanical context. One thus expects that the mechanical work 
corresponding to the oscillation of the plates with frequency cjp = 2uio, will 
be transformed into photons with frequency uiq- This is in agreement with 
the predictions of a more detailed quantum field calculation [7]. The trans- 
formation of mechanical work into light is reminiscent of sonoluminiscence 
[8]. This phenomenon was discovered in 1934 [9]: a short intense flash of 
light is observed when ultrasound-driven gas bubbles in water collapse. This 
transformation of sound wave into light however turns out to be a complex 
hydrochemical process involving Argon gas. The latter is the only one not to 
dissolve in water under the extreme conditions produced by the sound wave 
compression [10]. 

The list of physical systems in which parametric resonance appears is of 
course much longer. We just cite a few more examples [11], RLC circuits 
(the capacity or inductance oscillates), spiral waves in active media (an ap- 
plied electrical field oscillates), ferrofluids and 2-d electron gases (the applied 
magnetic field oscillates) , micro- wave guides (the temperature oscillates) and 
even the theory of the early universe (inflation oscillations). 
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3 Exactly Solvable Model 



Equation (1), called Hill’s equation, looks misleadingly simple. In fact no 
general explicit solution is known. For the case f(t) = A cos Upt it is known as 
the Mathieu equation. Explicit results are expressed in terms of the Mathieu 
functions, which are unfortunately quite complicated. We therefore turn to 
the case of a piece-wise constant function: 




+A 0 < t < T/2, modulo T 
—A T/2 < t < T, modulo T 



(4) 



for which both the physics and mathematics become very simple and reveal- 
ing. 

Let us first focus on the physical mechanism. During the phases where / 
is constant, (1) is the evolution equation for the plain harmonic oscillator, 
with conservation of the total energy 

— — = constant . (5) 

Hence the motion lies on ellipses in the phase space {x,x). Note that flat 
ellipses correspond to small w, cf. fig.2 for an example. Suppose now that we 



X 




Fig.2. A schematic representation of the phase-space trajectory of a parametric 
oscillator 



start in the low frequency phase (/ = —A) at a; = 0 with x some initial value 
(state 1 in fig.2). The phase point follows the ellipse until it reaches i; = 0 
with a nonzero maximal extension x. At this point (state 2), we switch to 
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the high frequency (/ = A). By doing so, we have to replace a soft extended 
spring by a stiff one with the same extension: we have to pump in energy equal 
to the corresponding gain in potential energy. We now proceed with this stiff 
spring and the phase point moves on a vertically elongated ellipse, until we 
again reach a; = 0 with nonzero x. At this point (state 3), we switch back to 
the soft spring, at no cost in energy however since x = 0. We conclude that 
by working in this way, implying that we have a full cycle in the perturbation 
for half a cycle of the oscillator itself, we are pumping in energy. 

We now turn to an explicit analytic solution. Defining A), 

we write the solution for position and velocity after a full period T of the 
perturbation in terms of the original values: 
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The two matrices appearing in the r.h.s. of (6) correspond to the propagator 
of the plain harmonic oscillator, operating at frequencies and a>_. The 
product of these two matrices gives the transformation after a full period. 
This so-called Floquet operator is independent of the initial conditions and 
gives by repeated application the long time behavior of the system. Its eigen- 
values Ai, A 2 determine whether or not the amplitude will explode. In the 
present case, one first finds that A 1 A 2 = 1. In other words, the Jacobian of 
the transformation from (xq,xo) to (xt,xt) is equal to 1, implying conserva- 
tion of volume in phase space. This is nothing but Liouville’s theorem. Two 
cases can now appear. Either Ai and A 2 are complex conjugate, and thus lie 
on tjie unit circle. Or they are real and each other’s inverse. In the latter 
case, one eigenvalue will be larger than 1 in modulus and the corresponding 
eigenvector will have a diverging amplitude. The only points at which the 
complex conjugate pair can switch to inverse real values are Ai = A 2 = ±1. 
So the critical condition that delimitates oscillation from explosion is given 
by the trace of the Floquet operator equal to ±2, A simple calculation leads 
to the following explicit result: 
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= ±1 



(7) 



For small amplitude A of the perturbation, these conditions simplify to: 
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The exact boundaries as given by (7) are represented in fig.3. The oscillator 
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Fig. 3. The frontiers of the parametric resonance for a single oscillator subject to 
a block perturbation, cf. eq.(4), in parameter space (A, ujo/ujp), for different values 
of the friction coefficient 7 . Note that the 7 = 0 curves touch the A = 0 axis. The 
domains inside the curves correspond to the region of instability 



will have a diverging amplitude for any couple of parameter values A and 
wo/wp inside the curves. Note that the most pronounced and widest instability 
region, especially at small amplitude, is delimited by wo/wp = 1/2 ± A/27t, 
in agreement with our earlier statements. 

We also mention a curious feature, related to the operation of the Paul 
trap: for A > 1, = Wo(l + /) is actually negative for / = -A. Hence 

the oscillator has a repulsive spring and an inverted parabola as potential. 
Nevertheless, as can be clearly seen on fig. 3, there are regions in parameter 
space where the amplitude of the oscillator does not diverge. It is in these 
regions that the Paul trap operates. 

Some final comments. A friction term — jx can be included in (1), but does 
not complicate matters at all. It can be transformed away by switching to a 
new variable y(t) = x{t). The effect of friction on the instability region is 

as expected: they shrink, and quite dramatically, see fig. 3. Again the wo/wp = 
2 region appears to be somewhat more robust. An important difference with 
the usual additive periodic driving should be mentioned: friction does not 
prevent the explosion of the amplitude when one is in an unstable parameter 
regime. Nonlinear terms, e.g. — x^, are needed to stop the divergence. But 
those terms do not modify the appearance and the location of the instability. 

Finally, we mention the close connection with the Bloch theory for elec- 
trons in metal [12]. The stationary Schrodinger equation 
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where (. . .)' represents the spatial derivative, and V is a spatially periodic 
potential modelling the attractions of the array’s ions on the electrons, is 
formally identic to eq.(l) with time replaced by space. The energy values 
for which the corresponding wave function diverges exponentially with the 
distance form the forbidden bands and are the equivalent of the regions of 
parametric resonance in the oscillator problem. The specific square wave form 
used above for the potential is called the Kronig-Penney model in solid state 
physics. 

4 Coupled Parametric Oscillators 

The physics of coupled oscillators has a long and very interesting history 
[13]. Of course, the simplest case of a linear chain of harmonically coupled 
particles is discussed in each introductory physics class. In the continuum 
limit, one gets the non-dispersive wave equation. When each particle is, in 
addition, subjected to a harmonic substrate potential, the equation of motion 
is known as the (discrete version of the) Klein Gordon equation; 

Xi - u>lxi = -K{2xi - Xj+i - Xi-i) (11) 

where Xj is the coordinate of the i-th oscillator, wq the eigenfrequency, and K 
the spring constant coupling neighbouring oscillators. A huge effort, prompted 
in part by such surprising discoveries as the KAM theory and the existence 
of solitons [14], has been devoted to investigate what happens when non- 
linear terms are added. Another great deal of effort, following the discovery 
of Ahderson localization in linear systems with disorder and the relation to 
the theory of random matrices, has been focused on studying the effect of 
disorder [15]. 

We would like to report briefly on the exact solution for a model that, in 
a sense, lies at the borderline of these two endeavors, namely the harmoni- 
cally coupled parametric oscillators with quenched distributed phases. Even 
though the system is technically speaking linear, it would not be classified 
as such in the theory of nonlinear dynamics since periodic terms such as 
xcoscjf may be replaced, through the introduction of a new variable y = tut, 
j/ = tu, by a multiplicative term xcosy. On the other hand, we will introduce 
disorder to induce the effect of interest, but the disorder will only appear in 
the parametric signal and hence not in the physical system itself. The model 
system that we consider is described by the following evolution law: 

K ^ ^ 

Xi -^Xi-uj'^{t + ipi)xi = - —'^{Xi-Xj) (12) 

3=1 

with given, as before, by iuq[ 1 + /(f)]. In other words, we consider N 

globally harmonically coupled parametric oscillators, identical to the ones 
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discussed before, each however with a random phase slip (pi in its parametric 
perturbation. Furthermore, we focus on the thermodynamic limit iV— )-oo, and 
anticipate that the r.h.s. of (12) is self-averaging. Every single oscillator x is 
thus coupled to the mean field < x >: 

X — 7 x — -I- p>)x = —K{x — < X >) (13) 

where < x > has to be determined self-consistently by averaging the solution 
of (13) over the random phase tp. The resulting equation for < x > can 
be obtained explicitly after a lengthy calculation, and the question can be 
addressed whether < x > (and hence every oscillator) “explodes” or not. 
The critical parameter values - that correspond to < x > = constant, i.e. 
to a behavior that lies between the relaxation and the “explosion” - can be 
obtained analytically for the case of a uniform distribution of (p in [0, T [, see 
[16]. But rather than reproducing these results here, we show in fig. 4 (a), (b) 
the instability region (inside the critical curves) for some typical values of the 
parameters. It turns out that this collective instability has a different nature 
than the simple individual parametric resonance. In particular, as shown 





Fig. 4. The frontiers of the collective instability in parameters plane {A,LJo/(Vp) for 
uio = 0.4, 7 = 0.16. The instability appears in the regions inside the curves, (a) 
The region of collective instability {continuous line, K = 1.28) is larger than the 
region of parametric resonance (dashed-dotted line) (b) Illustration of the reentrance 
phenomenon, see text: for K = 6.40 the region of instability becomes significantly 
smaller 



in fig.4(a), it appears in a wider region of parameter space than the usual 
parametric resonance It also persists in the overdamped limit m -> 0, 

^ Note that coupling between the oscillators reduces the domain of the usual pcura- 
metric instability for each individuzd. 
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where the parametric resonance is no longer possible. There are two main 
ingredients for the appearance of this new collective transition: a parametric 
perturbation with a random ingredient. This assures a broad distribution 
of |a:|-values, so that the average can significantly deviate from its typical 
value. Hence, at each moment, there are some oscillators that have large \x\ 
values, thus providing a dominant contribution to the mean field < x >, 
and thereby entraining the other oscillators away from the “absorbing” state 
X — 0. This pool of “transiently large members” is changing in a complicated 
manner in time. A peculiar feature of the transition is the reentrance with 
respect to the coupling strength K, see fig. 4(b). The collective instability 
obviously disappears in the absence of coupling, but also when the coupling 
is too strong. In the latter case, the differences between the oscillators are 
suppressed, and they behave like a single unit. The presence of saturating 
nonlinearities, e.g. a term in —x^ in (13), limitates the explosion of < a; >, 
and turns the instability into a genuine second order nonequilibrium phase 
transition, displaying broken spatial symmetry and ergodicity. Even though 
an exact analytic treatment of the problem becomes impossible in this case, 
numerical simulations show that the order parameter < a: > is continuosly 
growing from zero as one crosses the critical point, while critical fiuctuations 
are observed in the vicinity of this point. Furthermore, extensive simulations 
of the model in spatial dimension D = 2 on a square-like array, with first 
neighbour coupling between the oscillators, show critical slowing down and 
divergence of spatial correlation length. 

5 Discussion 

Our original motivation for studying coupled parametric oscillators is the 
occurrence of noise induced phase transitions in systems with multiplicative 
noise terms [17]. The origin of these phase transitions can be traced back to 
the fact that multiplicative noise introduces a so-called spurious drift term. 
For example, for an evolution equation of the form x = f{x) + g{x)^, with ^ 
a Gaussian white noise with intensity a^, one finds, in Stratonovich interpre- 
tation, that < g{x)^ >= 2(7^ < g{x)g'{x) >. When g{x) has a minimum at a 
reference state, the spurious drift term can, in coupled systems, destabilize the 
latter state by what has been called a noise induced phase transition. These 
transitions have very specific properties (for example reentrance in function 
of the noise intensity) and are found to be quite robust. It particular, these 
phase transitions persist for the case of colored noise, for example when ^ is a 
dichotomic Markov noise. It is then quite natural to make the transition from 
a stochastic dichotomic noise, which has random sojourn times in both states, 
to the parametric perturbation /(f) considered here. As reported in the previ- 
ous section, we find that the analogue of noise induced phase transitions does 
indeed appear when considering parametric perturbations with quenched dis- 
order. In this way, we have closed a historic loop ; the early study of periodic 
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parametric perturbations by the Russian school probably led Stratonovich to 
his calculus for multiplicative noise. In this context, it is revealing to mention 
that for the evolution equation x = f{x) + g{x) cos(wt) in the limit of large 
frequency uj one finds that < g(x)cos(wt) >= -2g{< x >)g'(< x >)/(4w^), 
an expression reminiscent of the Stratonovich spurious drift term [18]. The 
latter term captures in a very simple and explicit way what would otherwise 
appear to be a quite complicated feedback of multiplicative noise term on its 
own amplitude. In retrospect it is surprising that the stochastic white noise 
case can, using the associated powerful calculation tools such as the Fokker 
Planck equation, be discussed in much more detail including for example the 
effect of nonlinear terms. But the example discussed in the previous section 
provides an interesting borderline case between linear and nonlinear problems 
that can also be solved in great detail. 
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Abstract. As an example of phenomena which lead to noise-induced ordering we 
consider noise-induced phase transitions resulting in the excitation of noise-induced 
oscillations. Our first example is a pendulum with the randomly vibrated suspension 
axis. We discuss a control of noise-induced oscillations in this system and an effect of 
the on-off intermittency. The second example is a model for the interaction between 
tropical atmosphere and ocean water to explain a generation of an annual signal in 
tropics. This model demonstrates noise-induced oscillations which closely resemble 
in its form chaotic oscillations. 



1 Introduction 

Nowadays it is not surprising that an influence of noise on the nonequilibrium 
nonlinear system may be much more nontrivial as only leading to disorder. 
As examples of numerous phenomena which manifest the ability of noise 
to induce order one can enumerate stochastic resonance [1], noise- induced 
transport [2,3], coherence resonance [4], noise-enhanced phase synchroniza- 
tion [5], resonant activation [6], etc. Among these phenomena noise-induced 
phase transitions play an important role. It has been recently demonstrated 
that noise-induced transitions can lead to the appearance of additional max- 
ima in the system probability distribution [7], the excitation of noise-induced 
oscillations [8,9], and the creation of a mean field in spatially distributed 
systems [10-13]. In the present work we concentrate our attention on noise- 
induced oscillations which appear as a result of a noise-induced transition. 
For this we examine different typical models demonstrating such a transition. 

First we study a pendulum with randomly vibrated suspension axis, which 
exhibits noise-induced oscillations if the noise intensity exceeds it critical 
value [8]. Then we discuss the effect of on-off intermittency [14] and a pos- 
sibility to control noise-induced oscillations by an additional periodic action 
[15]. In Section 4 we consider the Vallis model of a nonlinear interaction 
between ocean water and atmosphere. In this model both chaotic and noise- 
induced oscillations may be excited depending whether the external action 
on the system is a periodic force or noise. Both oscillations look similar and it 
means that noise is able to reveal intrinsic properties of this nonlinear system. 
Finally, we summarize the results discussed. 
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2 Noise-Induced Phase Transition in a Pendulum 



In this section we consider multiplicative noise induced phase transition which 
leads to the excitation of oscillations. This transition is demonstrated by 
a pendulum with suspension axis randomly vibrated in a certain direction 
making an angle 7 with the vertical axis[8, 16]. The equation of motion for 
this system can be written as 

Cp -I- -I- aip^)ip + u}Q sin(^ -|-a;o^(t) sin((^ -t- 7) = 0, (1) 

where (p is the pendulum angular deviation from the equilibrium position, loq 
is the natural frequency of small free pendulum oscillations, /3 is a damping 
factor with the nonlinear coefficient cr, and ^{t) is a comparatively wide-band 
random process (Fig. 1). 





Fig. 1. Left: A sketch of a pendulum with randomly vibrated suspension axis. Right: 
The dependence of the averaged amplitude squared on t], defined by the eq. (5). 
The curve 1 corresponds to the case without additive noise, curves 2 and 3 to the 
cases with additive noise intensities k 1 and k 2, where k2 > k1. Analytical and 
numerical results are shown by solid and symbol curves, respectively. 



Assuming that an intensity of the suspension axis vibration is moderately 
small, the equation of motion becomes 

if + 2/3{l + a(p‘^)(f -t Wo(l + ^i{t))tp = Wo^2(f) (2) 

where ^i(f) = ^(f)cos7 is a multiplicative component of the suspension vi- 
bration, and ^ 2 {t) = — ^(f)sin7 is its additive component. 

The equation can be solved approximately by using the Krylov-Bogolyubov 
method to obtain equations for the amplitude A and phase of the resulting 
oscillations, and solving these equations by the method of the Fokker-Planck 
equation (for details see [16, 17]). First, we analyze the case without additive 
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noise (^2 =0). In this case we obtain the following expressions for (A) and 

(A2); 



(^) 



rA—r{ 


(4/; + 1)/2(1 + ?7) j 


1 2a(l + v) r 


(3t,/2(1 + 77) + l) 



Tj for Tj >0 



{A^) = 




0 for ?7 < 0 

for 7j > 0 

for t; < 0 



(3) 

(4) 



The parameter 

T] = 3uJq(k(2ujo) - Kcr)/(16^) (5) 

is the extent to which the intensity of multiplicative noise k{2u>o) at the 
frequency 2wo exceeds its critical value and a = 3o:ajo/4. 

The dependence of the averaged amplitude squared a{A?) on t] is shown 
in Fig. 1, left, curve 1. This figure shows that the parametrical action of 
noise ^i(t) leads to a phase transition: below a threshold we get (A^) = 0, 
and after a threshold noise-induced oscillations are excited and its intensity 
increases with an increase of the noise intensity. In this phase transition (on 
the terminology see discussion in [8, 16]) the role of temperature is played by 
the intensity of multiplicative noise, and the average amplitude squared is 
the order parameter for this system . Note also that in the presented system 
the excitation by periodic force is also possible; the comparison with that 
case- can be found in [8]. 

In the presence of additive noise the dependencies will be qualitatively 
changed. For o(A^) we obtain [17]: a(A^) = 



3 



(1 -t-r?) 

3g 

2(1 + r?) ^ 

[A 



^{2^x)^ Q - 2/xj (1 + 2^i) (^2(1 - 2p) + (5 - 4/i) 



3g 



V)Fr(-2/r)(l - 2pi) ()"'*+' + ^q^{2^l)^ ( ^ - 2/i 



2{1 + V) 
(l + 2p) ^ 
(l+»7) j 



2 + 



3g 



2fi 



2(1 -f- 2/j,) + 



9q 



2(1 + r?) 



+ 



r(2M)r(|-2,)(l + 2rt(2(l-2ri + ^|j^)] . 



( 6 ) 



where fi = 3(?7 + ?)/4(l + r/), q = 4aK^^/K{2ujo), and is the intensity of 
additive noise. 

Two example of dependencies are shown by curves 2 and 3 in Fig. 1, 
right, for the additive noise intensities /cl and k2, where /c2 > /cl. A presence 
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of additive noise leads to the fact that a probability distribution below the 
threshold is not longer a J-function, and the transition is now not so well- 
defined, as in the case without additive noise. 




Fig. 2. The on-off intermittency in the behaviour of (p(t) for subcritical values of 
multiplicative noise intensity (rj = —0.3) in the presence of additive noise (q = 
0.007). 



As a distinguishing feature of both noise-induced transitions presented 
we find on-off intermittency: in the time series slight oscillations alternate 
with short strong bursts [14]. Additive noise influences this effect strongly. 
Without additive noise on-off intermittency is observed near a threshold for 
supercritical values of multiplicative noise intensity, whereas in the presence 
of additive noise this on-off intermittency is hidden, but now already observ- 
able below a threshold (see Fig. 2). 

3 Control of Noise-Induced Oscillations 

Next we study how to control these oscillations by a harmonic action. The 
equation for the description of noise-induced pendulum’s oscillations under 
control is 

(p + 2i3 (l + aip^) <fi + uiQ{l+ ^i(t) -h a cos Wat) sine/? = WQ^ 2 (t), (7) 

with the same parameters as eq.(l); a and Wq are, respectively, the am- 
plitude and frequency of the additional vibration of the suspension axis. 

Our aim is to investigate the influence of this additional harmonic action 
upon the pendulum. This study was mainly incited by the known inves- 
tigations on the intensification and suppression of turbulent pulsations in 
subsonic jets by slight acoustic field [18]. One of the purposes of our study 
is to emphasize some analogues between turbulent processes in non-closed 
flows and noise-induced pendulum’s oscillations [18,19]. Here we discuss the 
problem of controlling the intensity of the pendulum’s oscillations by an addi- 
tional harmonic action, either multiplicative or additive. Because both types 
of the action result in the same qualitative effects, we dwell mainly on a 
multiplicative action. Such an action corresponds to an additional harmonic 
vibration of the pendulum’s suspension axis. 
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3.1 Initiation and Intensification of the Pendulum’s Oscillations 
by a Low Frequency Harmonic Action 

First we consider the case ^2 = 0, i.e. without additive noise. The results of 
numerical simulation of Eq. (7) for k{2ujo) < Kcr and different values of a are 
represented in Fig. 3. In this case the excitation of oscillations is of a threshold 
character with the amplitude threshold value depending on k{2ijJo)I i^cr- For 
uja = 0.3, K(2wo)/«cr = 0.51 the threshold value of a is equal to 1.15. For 
a > Ocr the oscillations excited cannot practically be distinguished from those 
excited due to random vibration only. 




Fig. 3. The excitation of oscillations by a low-frequency harmonic action: the in- 
tensity of multiplicative noise is below a threshold. The dependencies of (p{t) are 
shown for ^2 = 0, /c(2wo)/Kcr = 0.51, Wa = 0.3, and different values of the action 
amplitude: (a) a = 1.151, (6) a = 1.3, (c) a = 1.5. 



The oscillation intensity is the greater, the larger is a. The dependence of 
the root-mean-square value of pendulum’s angular deviation = ((/?^) on the 
difference between the amplitude a and its threshold value Ucr is found to be 
nearly linear (Fig. 4 a). So, we see that the low frequency vibration initiates 
the noise-induced phase transition and the birth of an induced attractor. 

Again the initiation of the pendulum’s oscillations by a low frequency 
additional action occurs via on-off intermittency. As a increases, the mean 
duration of laminar phases r decreases. We have found that the dependence 
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(a) 




(b) 




a 



a 



Fig. 4. The dependencies of the root mean square value of the pendulum’s oscilla- 
tions (T on a for (a) K(2iJo)/«cr = 0.51, Wa = 0.3 (the dependence a = 0.48(a — 1.1) 
is shown as a solid line), (6) «;(2a;o)//tcr(2) = 1.89, Wa = 0.3. 



of r on a [15] is in good accordance with the formula r = 0.44/(a^ — a^^), 
where a„ = 1.15. 

If the intensity of the suspension axis random vibration is in excess of 
its threshold value, i.e. k(2o;o) > Kcr, an additional low frequency vibration 
significantly intensifies the noise-induced oscillations. The dependence of a 
on a for /t(2wo)/«:cr = 1-89, u)a — 0.3 is shown in Fig. 4 b. We see that small 
actions leave the pendulum’s oscillations nearly unaffected. But, beginning 
with a certain action amplitude, the variance of the pendulum’s oscillations 
rises steeply. 



3.2 Suppression of the Pendulum’s Oscillations 
by a High Frequency Harmonic Action 

If the frequency of additional harmonic action is sufficiently high, then a 
suppression of noise-induced pendulum’s oscillations occurs instead of their 
intensification. From results of numerical simulation of Eq. (7) for uja > 2wo, 
we see that, for small amplitudes of the high frequency action, this action 
has a slight or no effect on the existing noise-induced oscillations (Fig. 4) . As 
the action amplitude increases, the intensity of the noise-induced oscillations 
decreases rapidly and in the absence of additive noise for a certain value of 
the action amplitude the oscillations are suppressed entirely. For example, for 
k/kct = 5.6, uJa = 20 this amplitude value is equal to 83.5. It is evident that 
in the presence of additive noise noise-induced pendulum’s oscillations cannot 
be entirely suppressed, but the suppression can be impressive (Fig. 5d). 

Figure 5 shows that the suppression of noise-induced oscillations, like 
their excitation in the absence of an external action and initiation by a low 
frequency action, occurs via on-off intermittency. As the action amplitude 
increases, the duration of “laminar” phases increases too. The dependence of 
the mean duration of “laminar” phases t on the action amplitude a for e = 
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Fig. 5. Suppression of noise-induced oscillations. The dependencies of (p(t) for 
k{2ijjci) j Her = 5.6, uia = 20, (o) $2 = 0, a = 10, (6) ^2 = 0, a = 30, (c) ^2 = 0, 
a = 70 and (d) = 0.05/t(2wo), a = 70. It is seen that in the presence of additive 

noise the pendulum’s oscillations can not be suppressed entirely. 



0.002, k(2cjo)/kc 7- = 6.25 (for excimple) can be appropriately approximated 
by the dependence r = 1900/(a^r ~ ®cr = 83.5. 

The dependencies of the intensity of the pendulum’s oscillations on the 
amplitude and frequency of the action are shown in Fig. 6. It is seen from 
Fig. 6 a that in the case of moderately high frequencies of the action the inten- 
sity of noise-induced pendulum’s oscillations with increasing action amplitude 
first decreases to a certain minimal value and then increases; for sufficiently 
large amplitudes of the action it can become even more than in the absence 
of the action. It should be noted that this minimal value is the smaller the 
greater is the action frequency and it is attained for the larger amplitudes 
of the action, the higher is the action frequency. If the action frequency is 
sufficiently high then, as indicated above, a complete suppression occurs. 
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(a) (b) 





Fig. 6. (a) The dependencies of <r on a for uio = \, — 0.1, a = 100, 

k{2ujq)/kct = 5.6, (jJa = 3.5 (circles), u>a — 11 (squares), and Ua = 20 (trian- 
gles)] (b) the dependencies of cr on uja for a = 3 (circles), a = 40 (squares), a = 80 
(triangles). 



If we change the frequency of the action for a fixed value of its ampli- 
tude (Fig. 6 6), the intensity of noise-induced pendulum’s oscillations with 
increasing action frequency first decreases to a certain minimal value, which 
is the smaller the greater is the action amplitude, and then increases. This 
minimal value is attained for the higher frequencies of the action, the larger is 
its amplitude. So, there exist some optimal value of the controlling parameter 
(either a oi uj a) for which the suppression is most effective. Some analytical 
calculations to describe this suppression are presented in [20]. 

4 Noise-Induced Oscillations in the Vallis Model 

Recently it was shown [21] that there exist nonlinear systems with such pro- 
nounced intrinsic properties that the form of oscillations excited depends only 
slightly on the reason of their excitation . In this section we demonstrate an- 
other example of a system which manifests similar behavior. We study a 
simple conceptual model of non-linear interaction between ocean water and 
the atmosphere under the action of noise. Initially this model has been pro- 
posed by Vallis [22, 23] for the explanation of the intriguing climatological 
phenomenon known cis ‘El Nino or Southern Oscillation’. This phenomenon 
consists of an interannual appearance of the strongest signal in the tropics. 

The key idea of this model is the description of the upward resp. downward 
motion of air in dependence on whether it is over warm resp. cold water. This 
motion is a reason of the wind which, in its turn, induces a surface flow in the 
ocean. Therefore the surface temperatures at the western and eastern edges 
of the ocean basin are affected by horizontal advection and, as a consequence, 
oscillations may appear. 
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The model is described by the following set of equations: 

U = ~ + U*), 

7 / 

= ^(To-Te)-A(r„-T*), (8) 

T« = ^(T„-To)-A(T,-T*), 

where u is the velocity of the ocean’s surface flow, Tg and T^, are the 
temperatures at the western and eastern edges of the ocean, respectively, 
is the relaxation time of the temperature, B is the coupling factor between 
the temperature difference and the ocean’s surface flow, (7 is a coefficient 
associated with internal friction in ocean water, I is the ocean basin width, 
To is the relative temperature of the deep ocean, T* is the relative steady 
state ocean temperature, and u* = uq + f{t) is a function describing the 
effect of the tradewinds. 

The Southern oscillations can be explained in the frames of a determinis- 
tic approach if periodic forcing is included in the model, i.e. f{t) = ui sinwf. 
In this case the model generates chaotic oscillations. These oscillations ap- 
pear for the set of parameters given in the capture of Fig. 7. Note that for 
parameter values given in [24,25], also self-oscillations of the same form can 
be excited. For parameters considered by us the behaviour of the model is 
the following: in the absence of periodic action (ui = 0) Eqs.(8) oscillations 
are damped. When the periodic force is present, chaotic oscillations arise 
(see Fig. 7), which have a rather intricate shape. Interesting to note that 
intermittency is observed in the form of oscillations. 

From the physical point of view the introduction of a noisy term in eqs.(8) 
instead of periodic action seems more justified. In this case f{t) = x(f)> where 
x{t) is a random process which is a solution of the equation 

X-t-27rx-t-67r^X = ^(0, (9) 

where is white noise with zero mean and intensity cr^: = 

alS{t - t'). 

It is easily seen that the spectral density of x{t) peaks at the frequency 
u) = 2n, that corresponds to the annual influence of tradewinds. 

If this type of noise acts on the nonlinear system, noise-induced oscil- 
lations appear, as shown in the Fig. 7. It is important to emphasize that 
these noise-induced oscillations closely resembles in its form the chaotic os- 
cillations obtained from the periodic forcing and therefore the introduction 
of noise may also explain experimentally observed data. Note also that the 
projection of the trajectory on the plain (u, Tyj) in the case of noisy action 
has the same form as in the deterministic case. 

These oscillations are excited as a result of the noise-induced transition. 
One can see it if we analyze the dependence of oscillations variance on the 
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periodic force 



noise 




Fig. 7. Similarity between chaotic and noise-induced oscillations in the Vallis model 
(8). Time series for u, T^, Te and the projection of the solution on the plane 
(u\Tw). The parameters are ui = 0.337n/s for chaotic and = HO for noise- 
induced oscillations. The remaining parameters are: B/21 — l.Sm/s year~^ , 
1/21 — 2.1024s/m year~^, C = Zyear~^, To = OK, T* = 12K, A = lyear~^, and 
Mo = 0.45m/s. 
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-13 



- 7.5 



- 2.5 



Fig. 8. Left: The dependence of oscillations variance (for variable u{t)) on the noise 
intensity. Right: the solution projection on the plane (u,Tu,) before = lOi black 
line) and far away after a transition = 140, shadow line). 



intensity of additive noise. This dependence is shown in the Fig. 8 (left). 
Clearly seen that for « 15 the dependence qualitatively changes it char- 
acter: the slope of the curve is drastically changing. It is connected also with 
the changes in the form of oscillations: after a transition oscillations possess 
the property of the on-off intermittency (Fig. 7). It can be also visualized if 
we compare the form of the solution projection on the plane (u, T^) before 
and after the transition (Fig. 8, right). 



5 Summary 

In conclusion, we have discussed excitation of noise-induced oscillations in dif- 
ferent models. Our first example [8] shows that nonequilibrium second-order 
phase transitions leading to the excitation of noise-induced oscillations are 
possible in such simple system as a pendulum. This noise-induced transition 
occurs via on-off intermittency which is demonstrated for noise intensities 
near a threshold. Studying the control of noise-induced oscillations by peri- 
odic force we have reported on two effects: a low-frequency action results in 
intensification or initiation of the noise-induced oscillations, whereas a high- 
frequency action suppresses them. It is important to note that these effects 
differ from a well known phenomenon of asynchronous excitation [26], and 
from asynchronous suppression of self-oscillations [26]. The detailed compar- 
ison can be found in [15]. It is very interesting that the noise-induced oscilla- 
tions may be quite similar in its properties to the oscillations which appear if 
the excitation is periodic and deterministic chaos is generated (shown here for 
the Vallis model) . It means that noise is able to reveal own properties of the 
nonlinear system which determine the form of the oscillations. Hence already 
known phenomena which have been explained in the frames of a deterministic 
theory, could be also successfully described by stochastic models. So, another 
direction of further investigation is connected with our expectation that a 
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class of phenomena explained by models with noise-induced behaviour will 
be substantially expanded in the nearest future [27], 
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Abstract. In their 1993 paper [14], Schimansky-Geier and Herzel discovered nu- 
merically that the Kramers oscillator (which is identical with the Duffing oscillator 
forced by additive white noise) has a positive top Lyapunov exponent in the low 
damping regime. 

In this paper, we study the Kramers oscillator from the point of view of random 
dynamical systems. In particular, we confirm the findings in the paper [14] about 
the Lyapunov exponent by performing more precise simulations, revealing that the 
Lyapunov exponent is positive up to a critical value of the damping, from which 
on it remains negative. 

We then show that the Kramers oscillator has a global random attractor which 
in the stable regime (large damping) is just a random point and in the unstable 
regime (small damping) has very complicated geometrical structure. In the lat- 
ter case the invariant measure supported by the attractor is a Sinai- Ruelle- Bowen 
measure with positive entropy. The Kramers oscillator hence undergoes a stochtistic 
bifurcation at the critical value of the damping parameter. 

1 Introduction 

Since its introduction by Duffing in 1918, the (forced) nonlinear oscillator 
with a cubic stiffness term given by 

Xt+jxt + U'ixt) = fit), C/(x) = -Oy -f 6— , a,6>0, 7>0, (1) 

has been one of the paradigms of nonlinear dynamics (see e.g. Guckenheimer 
and Holmes [5]). 

If the forcing is chosen to be 

fit) = ^(<), ^it) white noise, 

(1) describes stochastic motion of a particle in a bistable potential, where 
e > 0 stands for the temperature of a heat bath. This model was proposed 
and studied by Kramers in his celebrated paper [9], hence the name “Kramers 
oscillator” . 

We put e = a = b = 1 and write the Langevin equation (1) correctly as a 
stochastic differential equation (SDE) (see [1]) for xt, yt = if as 

dxt -ytdt, 

dyt = i-iyt - U'ixt)) dt + y/^dWt, (2) 



J.A. Freund and T. Pdschel (Eds.): LNP 557, pp. 280-291, 2000. 
(c) Springer- Verlag Berlin Heidelberg 2000 
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where Wt is a standard Wiener process. For every initial value ( 2 : 0 , j/o) the so- 
lution of (2) exists and forms a Markov process possessing a unique stationary 
measure with density 



p(x,y) = A^exp , (3) 

where W is a norming constant, i.e. p is the unique probability density solving 
the Fokker-Planck equation G*p = 0, where 

is the formal adjoint of the generator 

G = + + (5) 

of the Markov process. Note that p is independent of the friction (or damping) 
coefRcient 7 which will serve as a bifurcation parameter. This means that the 
family of SDE (2) does not undergo a P-bifurcation (see Arnold [2, Chap. 
9]), i.e. there is no qualitative change of the stationary density as 7 varies. 

The Lyapunov exponents Ai( 7 ) > A 2 ( 7 ) corresponding to the measure p 
are defined to be the two possible exponential growth rates of the solutions 
of the variational equation (linearization) of ( 2 ) given by 

X) = ( 1 -°3x? - 7 ) 

where Xt is the x component of the solution of ( 2 ) starting with random 
initial values (xo,yo) having density p. 

By the trace formula (see (15)), one can immediately read off from ( 6 ) 
that 

Ai ( 7 ) + A 2 ( 7 ) = — 7 < 0 for all 7 > 0 , 

meaning that the solution of the variational equation contracts volume at an 
exponential rate — 7 . 

Schimansky-Geier and Herzel [14] now observed the remarkable fact that 

Ai ( 7 ) >0 for 7 not too large. ( 7 ) 

This is, to our knowledge, the first example given of a dynamical system for 
which additive noise produces an unstable stationary measure. 

Our aim in this paper is to have a new look at the Kramers oscillator 
from the point of view of random dynamical systems. It will turn out that 
the Kramers oscillator has a global random attractor for all values of 7 , but 
it undergoes a stochastic bifurcation at that value of the friction coefRcient at 
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which Ai( 7 ) changes sign, with dramatic changes of the topological structure 
of the attractor and the invariant measure supported by the attractor. 

We stress that nothing of this is visible on the level of the Fokker-Planck 
equation, i.e. if we stay in the Markovian context, but only emerges from 
looking at the Kramers oscillator as a (random) dynamical system. 

2 Random Dynamical Systems 

We will now very briefly explain those concepts of the theory of random 
dynamical systems which are relevant for our case. We refer the reader to 
Arnold [2] for a more detailed and systematic treatment. The advantages 
of our approach is that we study randomness in the framework of classical 
dynamical systems theory, enabling us to utilize all its powerful machinery. 

Definition 1 (Random Dynamical System (RDS)). A (smooth) ran- 
dom dynamical system (RDS) tp on the state space with two-sided con- 
tinuous time E is a pair of the following objects: 

(i) Model of the noise: A metric dynamical system 6={6t)te.-R. in the sense 
of ergodic theory on a probability space (i?, .F, E), i.e. (t,cu) 6tu) is mea- 
surable and the family of selfmappings : f? i? of i? forms a flow (i.e. 
00 = id , 9t+s = Oto 6s for all s,f G E) which leaves the measure P invariant. 
We also assume for simplicity that 9 is ergodic. 

(ii) Model of the system perturbed by noise: A cocycle ip over 0, i.e. a 

measurable mapping : E x 17 x E*^ — t E**, {t,u>,x) i-t ip{t,u,x), for which 
(t,x) (->• p{t,u),x) is continuous and the family ip{t,u) : ^ , x 

ip{t,'u),x), of random selfmappings of E*^ are (continuously differentiable) 
and form a cocycle over 0, i.e. satisfy the cocycle property 

ip{0,oj) = id, (p{t + s,Lo) = ip{t,9su)oip{s,u}) for all t,s £ E and w £ Q . (8) 

Here o means composition of mappings. 

It follows from the cocycle property that all mappings are diffeomor- 

phisms, with inverse 

<p(t,co)~^ = ip{-t,9tuj). 

Now consider the (Stratonovich) SDE 

dxt = f{xt)dt + g{xt) o dWt (9) 

in E'* with m-dimensional Wiener process W . We can assume without loss 
of generality that time is two-sided, i.e. we solve (9) from t = 0 forwards as 
well as backwards in time. 

We claim that, modulo conditions [2, Sect. 2.3], the random mappings 
which assign to each initial value x € E*^ the solution p{t, u,x) of (9) at time 
t form an RDS. To this end, we model white noise resp. W as a dynamical 
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system by choosing {SI, SF, P) to be the Wiener space and by defining the shift 
on as 9tu){s) ui{t + s) — u}{t). Then 6 is an ergodic metric dynamical 
system on (17,^, P) “driving” the SDE (9), and W((w) = Lo{t). 

Invariant measures are of fundamental importance for an RDS as they 
encapsulate its long-term and ergodic behavior. Hence to find and describe 
them is one of the primary tasks. 

Definition 2 (Invariant and Stationary Measure). Let ip be an RDS. 

(i) A random probability measure lj (j,,^ on (R'^ , B'^), B‘^ the Borel sets 
in , is said to be invariant under (f if for alH e R 



(p{t,w)iXoj = fistu, P-a.s. 

(ii) A probability measure p on is called stationary for an SDE (9) 

if it is invariant under the Markov semigroup P{t,x,B) = P{w : p{t,cj,x) £ 
B} generated by the solution of the SDE for time R+ , i.e. if 

p(-) = / P{t,x,-)p{dx) for all t > 0. 



This is equivalent to the infinitesimal condition G*p = 0 (Fokker-Planck 
equation), where G* is the formal adjoint of the generator G of P{t,x,B) 
given by 



d 

i—l 



dxi 




d 

^ {9{^)9{x)*)ki 
k,l-l 



dxkdxi ' 



The concept of a stationary measure of the Markov semigroup corresponding 
to (9) is older and more restrictive than the concept of an invariant measure 
for the RDS generated by (9). There is, however, the following one-to-one 
correspondence between a stationary measures p and those invariant mea- 
sures p,^ which are measurable with respect to the past := a{Wt,t < 0) 
of the Wiener process (so-called Markov measures, see [2, Sect. 1.7]), the 
correspondence being given by 



py-^ Pij := lim ip{t,9-t0j)p, pi^ p := E/x. . 

t—^OO 



( 10 ) 



The basis for studying the long-term behavior of nonlinear systems by 
means of the exponential growth rates (today called Lyapunov exponents) 
of the solutions of the variational equation (linearization) is the celebrated 
Multiplicative Ergodic Theorem of Oseledets. We present this theorem just 
for the particular case of an RDS which is generated by an SDE with additive 
noise, and for a stationary measure [2, Theorem 4.2.13]. 

Theorem 1 (Multiplicative Ergodic Theorem for SDE). Let f €: 

be a vector field in R"^, let a be a fixed d x m matrix and let W be an m- 
dimensional Wiener process. Assume that the SDE 



dxt = f{xt)dt -f adWt 



( 11 ) 
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generates a unique RDSip. Letp{x) > 0 be the density of a stationary measure 
p[dx) = p(x)dx, i.e. p satisfies G*p = 0. Let Df(x) := 

Jacobian of f , 



dvt — Df{xt)vt dt 



( 12 ) 



the variational equation of (11), and assume that the following integrability 
condition is satisfied: 



/ \\D f(x)\\p(x)dx < oc. (13) 

Then there exist d real numbers, called the Lyapunov exponents of under 
P, 

-^1 ^ -^2 ^ ^ ( 14 ) 

which are the possible exponential growth rates of the solutions Vt{oj, xo,vq) = 
Dip{t,ui,xo)vo of the variational equation (12), i.e. for T-almost all to, p- 
almost all xq € and all vo{lj,xo) 6 



lim -log||ut(w,xo,r>o(w,xo)|| = A(w,xo,vo(w,^o)) 

t-*<x> t 



exists and takes on values from the finite list (14)- Furthermore, we have the 
trace formula 

At = / (trace D f {x))p{x) dx . (15) 

Jr<‘ 

The sign of the top Lyapunov exponent Ai hence determines the stability 
of the variational equation, and in turn (by appealing to the stable manifold 
theorem for RDS, see [2, Chap. 7]) the stability of the original nonlinear RDS 

T- 

It is thus important to obtain quantitative information about Ai which 
often can be drawn from a formula obtained by rewriting the variational 
equation (14) in polar coordinates r = ||n|| 6 (0, oo), s — G S'^~^ (the 
unit sphere in ) as a system 




dst = h(xt, st)dt, drt = Q(xt,St)rtdt, 



(16) 



where h(x,s) := Df(x)s - Q(x,s)s, Q(x,s) := (Df{x)s,s), and (x,y) := 
Y)i=i 111® standard scalar product in R** . 

Note that the equation for sj is decoupled from the one for rt, so that the 
pair (nt, Sf) forms a Markov process with state space E'* x S'^~^ and generator 
L = G + 

Integrating the equation for rt in (16) by separating variables, using the 
ergodic theorem and assuming the situation of Theorem 1 yields the following 
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result: There exists a stationary measure v for the Markov process {xt^st) on 
y gd-\ -^^rhose marginal on R** is p such that 

Ai = f {Df{x)s,s)v{dx,ds). (17) 

(17) is known as the Furstenberg-Khasminskii formula. 

We now generalize the concept of an attractor to the random case. 

Definition 3 (Attractor of RDS). Let ip be an RDS and let A{uj) be 
a random compact set, i.e. a; e-> A{u}) is a measurable mapping into the 
space of non- void compact subsets of Such a set is called invariant if 
(f{t,u!)A{(jj) — A(0tw) for all t and w. 

An invariant random compact set A is called a (global random) attractor 
of p if for any random variable X 

\imT{oj:d{ip{t,u!,X),A{6tio))>e} = 0 for all e > 0, (18) 

t—>oo 

where d{x, A) := infyg^ ||a; — 2 /|| is the distance of x and A. 

The existence of an attractor A(w) helps locating invariant measures, since 
by a result of Ochs [11, Theorem 2] 

p.u{A{uj)) = l P-a.s. (19) 

for any invariant measure p,^. 

3 Analysis of the Kramers Oscillator 

Consider the SDE (2) describing the Kramers oscillator. Recall that we make 
the choice e = a = 6 = 1. This is without loss of generality in the sense that 
the picture is qualitatively the same for another choice of the parameters. We 
choose 7 as the parameter which we would like to vary. 

As the coefficients of (2) do not satisfy global Lipschitz conditions, there 
is the possibility of explosion of solutions in finite time. We first have to make 
sure that the SDE indeed generates a global RDS ip. 

Theorem 2 (Existence of RDS). The SDE (2) for the Kramers oscillator 
generates a C°° RDS ip in R^ (this RDS will henceforth also he called the 
Kramers oscillator). 

This is a particular case of a result of Schenk-Hoppe [12, Theorem 5.8] for 
the Duffing oscillator with additive as well as multiplicative noise (see also 
[2, Sect. 9.4]). 

The next question is about invariant and stationary measures. As pointed 
out in the Introduction, it is a striking feature of the Kramers oscillator 
{U could be replaced by a more general potential) that the Fokker-Planck 
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equation G*p = 0, G* given by (4), can be explicitly solved to yield the 
density ( 3 ), and this density turns out to be independent of the friction 
parameter 7 . 

We claim that p{dx,dy) = p{x,y)dxdy is the unique stationary measure. 
This would be immediate if G* were elliptic (i.e. if the diffusion matrix era* 
were positive-definite). For the Kramers oscillator, however, the diffusion ma- 
trix 




has rank 1 , so we are in the non-elliptic case. 

To prove uniqueness of the stationary measure in the non-elliptic case we 
check whether the Lie algebra generated by the two vector fields f(x,y) = 
{y, -jy - U'{x)) and g{x, y) = (0, ^/2^) in (2) has full dimension 2. If yes, this 
implies that G and G* are hypoelliptic, hence all solutions oi G*q = 0 are 
However, by a result of Kliemann [ 8 ], a second measure with a smooth 
density cannot coexist with a measure whose density is positive everywhere. 

The Lie bracket [/, g] can be easily calculated to be 



[f,9]{x,y) 



{ -5i -g2^\ 

\h^ + f2^ - - 92^^ J 




At each (x,y) € the vectors g{x,y) and [f,g]{x,y) are clearly linearly 
independent proving that the corresponding Lie algebra is full. 

We summarize our findings in the following theorem. 

Theorem 3 (Existence and Uniqueness of Stationary Measure). The 

Kramers oscillator has the unique stationary measure 

p{dx, dy) = p{x, y)dxdy, p{x, y) = N exp “ y V (21) 



where N is a norming constant. 

Although p is independent of 7 (i.e. the long-term behavior of one trajectory 
(p{t,u},x) does not “feel” 7 ), the RDS (i.e. the simultaneous motion of two 
and more points) does depend on 7 , and so does the disintegration 



p^(dx,dy) — lim (p{t,0-ttj)p{dx,dy) 

t—^oo 

(see (19)). We will see that for small damping, p has many more invariant 
measures, due to the fact that tp has a highly nontrivial attractor. However, 
is the unique Markov measure. 

We next clarify the existence of an attractor. 

Theorem 4 (Existence and Uniqueness of Attractor). The Kramers 
oscillator has a unique global random attractor A{(aj) for any value 0/7 > 0. 
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This was proved by Imkeller and Schmalfuss [6, Sect. 3.4], using the only 
presently available technique for the white noise case which we briefly describe 
(following Ochs [10]): 

(i) Transform the SDE (2) into a random differential equation (containing 
real noise only) by using a linear random coordinate transformation keeping 
xt and replacing yt by zt=yt~ ^/^ut + where 

ut{ui) = u( 6 t 0 j) := j 

J — OO 

is the stationary Ornstein-Uhlenbeck process, i.e. the unique stationary so- 
lution of du = —^udt + dW. The transformed equations are 

Xt = Zt - '^Xt + s/^ut, Zt = -^zt-U'{xt) + '^xt, (22) 

where the white noise term has dropped out. 

(ii) Use the “Lyapunov function” V{x,z) := U{x) + ^ and prove that 
Vt < a(6tu)Vt d- I3{6tu]) with / adP < 0. 

(iii) The affine equation vt = a{dtu>)vt -f /3{9tU)) has a unique stationary 
solution, hence by (ii) and the comparison principle the equation (22) has an 
absorbing set. This implies the existence of a unique attractor for (22), hence 
for the Kramers oscillator. 

Theorem 5 (Lyapunov Exponents). Let ip be the Kramers oscillator and 
p{dx,dy) = p{x,y)dxdy be the unique stationary measure. 

(i) The integrability condition (13) for the variational equation ( 6 ) is sat- 
isfied, so that the Multiplicative Ergodic Theorem ( 1 ) for ip and p applies. In 
particular, 

Ai(7) + A2(t) = -7 < 0, 

thus 

Hi) ■•= Ai( 7) > - | > As ( 7 ). 

(ii) Stationary measure on x : Parametrizing the unit circle 5^ by 
s = (cos Q, sin a) and identifying points a = 0 and a = 2 -k of the interval 
[0, 27t], we have for the angle of the variational equation 

dat - h{xt,at)dt = (--x|cos2at - ^sin2at)dt. (23) 

The Markov process (xt,yt,at) on x [0,27 t] having generator 

L = G + h{x,a)^, 

where G is the generator of [xt,yt) given by (5), has exactly two stationary 
measures with marginal density p on These measures have support x 
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and C°° density q{x,y,a), resp. support x [^,7r] and density 
q{x,y,a- tt). 

(Hi) Furstenberg-Khasminskii formula: We have 




Proof, (i) The norm of the Jacobian 

satisfies |lD/(x)|| < (7i + C2x‘^ which is clearly integrable with respect to p 
as the density decays exponentially fast. 

(ii) Note first that all functions involved are 7r-periodic so that we can 
restrict ourselves to the a interval [— f , |], identifying again the endpoints. 

We first verify that the Lie algebra generated by the vector fields X — 
{y,-iy - U'(x),h{x,a)) and Y = (0,v^>0) on x has full rank 

3. This can be done with the recipe (20) by calculating [X,Y], [X, [X, F]], 
[X, [X, [X, y]]] and [[X, X], [X, [X, X]]] which we leave as an exercise. 

We conclude that L*, though not elliptic, is hypoelliptic, hence all solu- 
tions oi L*p = 0 are C°°. To prove uniqueness of the solution we utilize a 
result of Kliemann [8] saying that the possible supports of stationary mea- 
sures are the so-called Invariant control sets C of the deterministic control 
system 

6 = X(6)+u(t)X(6), 

where u{t) is a piecewise constant control function with values in R, and on 
such a C the stationary measure is unique. By directly inspecting the function 
h{x,a) we find that C = R^ x [-|,0] is the unique invariant control set. 

(iii) This is just formula (17) applied to our case taking into account 
TT-periodicity. 

Formula (24) can be used as the starting point for the asymptotic analysis of 
A(7) for small as well as large 7. For example, we dare to make the following 
conjecture. For details see Arnold and Imkeller [3]. 

Conjecture 1 (Asymptotic Expansion of Top Lyapunov Exponent). Assume 
the situation of Theorem 5. Then 

A(7) = Ai 7^^^ -I- 0(7^^^) for 7 ->■ 0, (25) 

where Ti > 0 and lim-,^o o(7^/^)/7^'^® = 0. 

In particular, there exists some 70 > 0 such that A (7) > 0 for all 7 6 
(0.7o). 
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Figures 1 and 2 depict the top Lyapunov exponent A(7) as a function of 7. 
Figure 1 shows the range 0 < 7 < 0.7 and Figure 2 the range 0 < 7 < 100. 
The data support that A (7) has a steep growth with vertical slope from 
A(0) = 0 to a positive maximum at 71 0.09. Then A(7) decays and crosses 

0 at 72 « 0.53, reaches its minimum at 73 » 4 and then seems to increase 
and converge to 0 for 7 —> 00. 

For the calculation we used the definition of A (7) as the exponential 
growth rate of a typical solution of (6). The SDE (2) was numerically in- 
tegrated by an Euler scheme with 10® steps of size 0.0005. We calculated 300 
values of A (7) for Figure 1 and 600 values for Figure 2. 




Fig. 1. The top Lyapunov exponent A( 7 ) of the Kramers oscillator for 0 < 7 < 0.7 




Fig. 2. The top Lyapunov exponent A( 7 ) of the Kramers oscillator for 0 < 7 < 100 



We now turn to the numerical computation of the attractor. For this 
we use a subdivision algorithm developed by Dellnitz and Hohmann [4] for 
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deterministic dynamical systems and adapted to the random case by Keller 
and Ochs [7, 10]. 

As the top Lyapunov exponent A(7) changes sign at 72 » 0.53, we expect 
a stochastic bifurcation (qualitative change of </;, see [2, Chap. 9j) on the level 
of attractors and invariant measures if 7 moves across 72 . 




Fig. 3. The random attractor A(uj) of the Kramers oscillator in the unstable regime 
(7 = 0.25) 



This can indeed be observed numerically: 

(i) Stable regime: For all parameter values 7 > 72 the global random 
attractor consists of just one random point, A{lj) = {a(6i;)}. It follows by 
(19) that the unique invariant measure of is the random Dirac measure 
fiu{dx,dy) = 6a(u){dx,dy) which is also the disintegration of the unique sta- 
tionary measure p in the sense of (10). 

(ii) Unstable regime: For all parameter values 7 G (0,72), the random 
attractor is a “chaotic” object with Cantor-set-type transversal intersections, 
see Figure 3 for a particular realization of A{u). Figure 3 was produced by 
the subdivision algorithm starting with a box of size 7x7 and stopping after 
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15 subdivisions in each direction. The fact that A{u)) is complicated is quite 
feasable because in this case Aj( 7 ) > 0 > A 2 ( 7 ), thus a typical point of the 
attractor has a one-dimensional unstable manifold which necessarily has to 
belong to the attractor (see Schenk-Hoppe [13, Theorem 7.3]). 

We refer the reader to Ochs [10] and the forthcoming paper by Arnold 
and Imkeller [3] for more details. 

We also have obtained numerical information on the disintegration jj,^ of 
p supported by A{lS) in the unstable case. It turns out that is so extremely 
complex that it cannot be reproduced without using colors. We claim that 
in this case is a Sinai-Ruelle-Bowen measure, and (p has positive fibre 
entropy h^{<p) under p^. The fibre entropy only measures the information 
production by the cocycle <p and suppresses the one by 9. More precisely, 

hi,{ip) = A(7) >0, 

where we have used Pesin’s entropy formula (which has never been rigorously 
proved for non-compact state spaces). 

Acknowledgement; The authors are grateful to Hannes Keller for pro- 
ducing the figures. 
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Abstract. The effects of low dimensional supports on the dynamics of open re- 
active systems are studied on two representative cases: the spinlike dynamics of 
immobile reactants for systems involving cooperative desorption and a lattice ver- 
sion of a Lotka-Volterra model involving reaction, adsorption and desorption. It 
is shown that the spatial constraints imposed by the support radically change the 
expected mean- field behavior. 



1 Introduction 

Recent experimental techniques have afforded new insights in the study of 
mesoscopic-scale structures arising on reactive surfaces [1-3]. Transient ef- 
fects associated with local pattern formation have now become accessible to 
direct experimental observation by applying scanning tunneling microscopy 
(STM). Field ion microscopy (FIM) is used to obtain nanoscale information 
on the occurrence of kinetic instabilities associated with sustained oscilla- 
tions, propagating waves and explosive behaviors. The analysis and under- 
standing of such phenomena require the development of new theoretical ap- 
proaches in which the tools of the theory of non-linear dynamical systems 
are supplemented with methodologies giving access to microscopic and meso- 
scopic level phenomena, such as non-equilibrium statistical physics, stochastic 
processes and computational techniques. 

It is well known that reactive processes on catalytic surfaces are influenced 
by a number of spatial constraints such as the limitations on the mobility of 
the adsorbed molecules, the localization of the reactions and the collision 
mechanism between the surrounding gas molecules and the active sites on 
the crystal surface. Moreover the occurrence of kinetic instabilites is often 
associated with adsorbate-induced surface restructuring. Attractive lateral 
interactions between adsorbates seem also to play a crucial role in pattern 
formation. All these facts indicate an intricate coupling between microscopic 
level processes and collective behavior as described by the macrovariables. 

Extended investigations of simple model systems that can be viewed as 
paradigms for reactive dynamics and anomalous transport in low dimension 
substrates have been reported in the literature. So far, most of this work 
has focused on diffusion-controlled reactions. Clearly, if the space where the 
reaction takes place is of low dimensionality (for instance a low dimensional 
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regular lattice or a fractal aggregate), the effective mobility of the diffusing 
particles is reduced. As a result, some reactions may take place with diffi- 
culty or be even forbidden and the mean-field (MF) picture that presumes 
an efficient “stirring” becomes questionable. In this context, some striking 
deviations from MF behavior have been discovered, such as fractal orders for 
elementary reactions, self-ordering and self-unmixing of reactants, and rate 
coefficients with temporal “memories” (see for instance [4]). 

For irreversible surface reactions as the ones occurring in heterogeneous 
catalysis, the rate limiting step may be the adsorption of gaseous reactants. 
For instance, the oxidation of carbon monoxide involves adsorption eventu- 
ally associated with dissociation of gaseous O 2 , reaction, and desorption of 
the product CO 2 (Langmuir- Hinshelwood kinetics). The mesoscopic approach 
based on Monte Carlo simulations [5] reveals the existence of a reaction win- 
dow for a certain range of partial pressure of CO. Outside this window, the 
catalytic surface is poisoned by atomic oxygen or by carbon monoxide and 
the oxidation stops. The occurrence of poisoning can be viewed as a nonequi- 
librium phase transition which is influenced by various factors such as the 
fractal nature of the surface, the spontaneous desorption of reactants, the 
adsorption mechanism, and the surface diffusion of reactants [6]. 

To explore the role played by the spatial confinement of chemical species 
in nonlinear surface reactive processes, we consider here the limit in which 
the mobility of reactants can be neglected. In this context, the departure 
from MF is directly related to the existence of a hard core not allowing more 
than one particle to be on a lattice node, together with short range inter- 
actions whereby particles can only react with their nearest neighbors whose 
number is small in low dimension substrates. A reactive process involving co- 
operative steps will thus proceed with difficulty on such supports. Since the 
reactive processes imply changes of identity of species involved, the progress 
of the reaction can be monitored by a spin-like variable whose number of al- 
lowed states is equal to the number of chemical species. Using this modeling, 
analytical methods include exact configuration enumeration and the master 
equation approach which can take into account local effects, inhomogeneous 
fluctuations and geometric constraints [7]. In parallel, kinetic Monte Carlo 
methods are used to simulate directly the underlying mesoscopic processes 
and to observe the resulting collective behavior. 

In Sec. II we discuss the cooperative desorption on a Id lattice as a repre- 
sentative case of spin-like dynamics. The emergence of a chemical oscillatory 
instability in low dimension lattices is presented in Sec.III along with a statis- 
tical analysis. Sec. IV is devoted to suggestions and perspectives for future work. 



2 Spin-Like Dynamics: The One-Dimensional Case 

To illustrate the correspondence between reactive processes on a Id lattice 
and spin-like dynamics, we consider the case of cooperative desorption usually 
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referred to as an annihilation reaction 

A + A^S + S . (1) 

Here A denotes the reactive species and S the empty lattice site. Such coop- 
erative desorption arises in heterogeneous catalysis-related problems, where 
A may stand for the reactive atomic form of an otherwise practically inert 
substance A 2 . In the mean-field limit, the final state is trivial. When this 
reaction scheme is implemented on a Id lattice, one gets a very different 
behavior entirely dominated by inhomogeneous fluctuations. 

Starting from a fully covered lattice, the time-independent state of the 
system is composed of sequences of free site pairs separated by isolated A- 
particles. Using combinatorial analysis, it is possible to compute the number 
of allowed configurations corresponding to a given global coverage. Let us 
denote by Mi,{n) the number of ways of placing n isolated A-particles on a 
Id lattice of size L with the restrictions imposed by the reaction (1). Between 
two A-particles, there is at least one pair of S sites. As a consequence, the 
effective length of the chain \s L' =n + and n — 1 sites of this L' lattice 
cannot be occupied by A-particles. If we assume fixed boundary conditions 
(2 S sites at the borders) there are only L' - (n - 1) - 2 = — 1 sites that 

can be filled by A-particles. We find 

( 2 ) 

The most probable value n/, is obtained by maximizing Miin) which gives 
in the thermodynamic limit the global coverage 

6»a = lim ^ = 0.1770 (3) 

1 j — ^00 1 j 

On the other hand, the statistical properties of the asymptotic state are 
directly accessible by performing Monte-Carlo (MC) simulations [5] of a Id 
lattice composed of L sites. The lattice chosen is composed of 2^^ sites and 
each simulation is performed over 2 • 10® MC steps. Starting from a uniform 
configuration in A-particles (all sites are occupied except the two edges), 
the observed final coverage equals 0.1354 which is significantly different from 
the predictions of the combinatoried analysis (3) although the final config- 
urations contain only isolated A. As shown in Fig. 1, for a smaller system 
(L ~ 10®), the histogram of the asymptotic coverage clearly does not over- 
lap with the theoretical distribution. Moreover, one observes a sensitivity of 
the simulation result towards the algorithm used (checking the occupancy of 
a random selected pair versus checking each of the neighbors of a random 
selected site occupied by A). This is rather unexpected for such a simple des- 
orption scheme and suggets that this system does not possess strong ergodic 
properties leading to a mixing of the available states. 
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Fig. 1. Asymptotic distributions of 
global coverage. The full line is the the- 
oretical probability given by the combi- 
natorial estimation (2). The histograms 
are constructed using Monte Carlo sim- 
ulations over 5 10‘‘ realizations for a lat- 
tice of size L = 902. The dashed line 
corresponds to an initial uniform state 
(04 (0) = 1) and the dotted one to a 
random configuration characterized by 
the coverage 04 (0) = 0.5. 



Fig. 2. Dependence of the global 
asymptotic coverage 6 a (t — > oo) on 
the initial state characterized by 0a (0). 
Each diamond represents the arith- 
metic mean value over 10 realizations. 
The lattice is 2^^ sites long. The dotted 
line corresponds to Pi given by eq. (4) 
in the long time limit. 



We have analyzed the dependence of the final global coverage on the 
initial condition 0 a ( 0) (see Figs. 1 and 2). For an initial coverage of 0.5, the 
initial condition is chosen as a random repartition of I./2 A-particles and 
contains A-clusters of various sizes separated by vacant sites. The chemical 
dynamics will destroy these clusters to give configurations with only isolated 
A-particles. The fact that the state is initially mixed influences the observed 
asymptotic coverage. The results of the systematic study of the influence of 
the initial characteristics of the support are summarized in Fig. 2. The strong 
influence of initial conditions on the final coverage further confirms the lack 
of ergodicity characterizing this desorption mechanism. 

These intriguing results can be understood by means of a microscopic 
study of the time relaxation toward the asymptotic state. Since we are dealing 
with a two state model, the problem can be mapped onto a spin system. 
We consider L spinlike variables crj = ±1 arranged on the sites i of a Id 
chain and corresponding, respectively, to a site occupied by an A-particle 
{a — 1) and a vacant site (cr = —1). Starting from some arbitrary initial state, 
the evolution of the probability distribution P{{a},t) of the set variables 
{a} = (ai ■ ■ ■ (7i ■ ■ ■ gl) with time is given by a Glauber Master equation [8] 
in which the transition probabilities describe the local chemical interaction. 
Although the general form of the time dependent solution P{{a},t) is not 
accessible, it is possible to extract relevant information on clusters dynamics. 
We consider an £-site connected cluster. As the reaction proceeds, a cluster 
occupied by homologous particles will progressively be destroyed from the 
inside or by interaction with the nearest neighbor sites immediately outside 
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the cluster. The probability Pt{t) that an ^-cluster be fully occupied by A- 
particles is simply the reduced probability 

Pe{t) = XI X] X - X . 

<Ti = il CTi=±l CT£,=±1 

If the lattice sites are initially occupied at random with probability p, the 
initial coverage of the lattice 0a (0) equals p and the initial probability of 
finding a Acluster is simply Pf(0) = p^. From the Glauber equation it is 
straightforward to derive an evolution equation for P( whose solution is given 
by [9, 10] 

Pi{t) = p exp (-2p(l - e“‘)) . (4) 

All probabilities P^>i vanish asymptotically, meaning that all clusters con- 
taining more than one particle disappear sooner or later from the system. 
The most interesting quantity is Pi(t) which decreases in time but remains 
finite as T ^ oo. Pi,oo corresponds to the asymptotic global coverage of iso- 
lated particles and is directly monitored in the MC simulation. An interesting 
feature is the explicit nonlinear dependence of the surviving reactant density 
on the initial coverage, even in the asymptotic limit, 

p—l Pi,oo = = 0.135 

p = 1/2 Pi,oc = = 0.184 . 

As shown in Fig. 2, the dependence in the initial coverage is in full agreement 
with MC results. Similar results are obtained in the case of partial desorption 
A -f- A — > A + S [10]. 

We have identified here a mechanism of failure of MF description in low 
dimensional systems, associated with the lack of ergodicity of the invariant 
state. More specifically, the invariant probability is not defined on a single 
ergodic set of states, but can be decomposed into a large (exponentially grow- 
ing with size) number of states, each of which remains invariant under the 
dynamics. The relative weight of each of these configurations depends on the 
initial condition, and thus explains the strong dependence of the results on 
the initial coverage of the lattice. 

This analysis is restricted by the simplifying assumption of immobile re- 
actants. Incorporating mobility of chemical species should allow for an A 
particle to come eventually to the immediate neighborhood of another A 
particle, even if initially they were both surrounded by empty sites. Our mi- 
croscopic description can be adapted to this possibility. It would certainly be 
worth seeing whether this suffices to establish ergodicity in one dimension. 

The natural extension of this work is to take into account more than 
one reactive species in the lattice. Including the empty sites would lead to a 
problem in which each lattice point can be in at least three possible states. 
Such “spin one” , or higher problems, have recently attracted attention in the 
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literature [11]. Prom the standpoint of the Master equation formalism, we 
can consider for instance an annihilation reaction involving different species 
A + B -> S + S. The study of the cluster dynamics will certainly be helpful 
to clarify the phenomenon of spontaneous segregation which is known to be 
influenced by the initial state. 

3 Spatio-temporal Dynamics 
in Low-Dimensional Substrates 

We now turn to reactive dynamics capable of generating complex behavior 
in space and/or in time in Id and 2d supports. For a typical autocatalytic 
reaction A + (n — 1)X nX taking place on a fully covered lattice in the 
limit in which reactant mobility is neglected, it has been shown that the 
asymptotic state may differ significantly from the expected MF value [12]. 

If the order of reaction is two, the ratio between A and X concentrations 
coincides with the MF value in Id and 2d lattices. While for a trimolecular 
reaction (n = 3), this result remains only valid for a 2d square lattice. For 
a Id support or for 2d regular lattices such as hexagonal or modified square 
lattices as well as for fractal supports, the MF is not recovered. The failure of 
the MF is directly related to the formation of frozen nonequilibrium clusters 
of A particles which could not relax toward the final equilibrium composition 
given by the law of mass action. Through a systematic analysis, it has been 
possible to assess the role played by the mean coordination number which is 
directly related to the geometry of the support [13]. Moreover, the stability 
of the steady state with respect to a small influx flow depends on the support 
characteristics. 

For closed reactive systems, the effect of spatial restrictions imposed by 
the lattice result in shifting the equilibrium steady-state and modifiying the 
temporal approach to equilibrium [14]. For open reactive systems with bista- 
bility (Schlogl models) more dramatic effects may take place such as the 
change from bistable to monostable behavior[15]. All these effects are due 
to space limitations in the sense that the particles can interact only with 
their neighbors and not with the entire system as implicitly assumed in the 
mean-field description. This is also the reason why the deviations from the 
mean-field behavior are stronger in lower dimensions. As the dimensionality 
and coordination number grow the reactive behavior approaches the mean- 
field limit. 

The mesoscopic approach of lattice reactive processes might improve our 
understanding of complex phenomena taking place in real catalytic systems. 
Indeed the behavior of surface reactions can be influenced by the structural 
conformation of the catalyst. For example, in the case of CO oxidation on Pt 
cristal, the surface performs transitions from hexagonal to square structure 
according to the adsorbate concentration. This kind of coupling is the basic 
mechanism which leads to kinetic oscillations. The simple autocatalytic re- 
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action mentioned above, if coupled with a transition of the lattice structure, 
shows already this type of phenomenon [13]. 

Nonlinear reactive schemes in homogeneous phase are known to give rise 
to a variety of complex behaviors, such as periodic or chaotic oscillations and 
spatial or spatio-temporal patterns. Since a good deal of chemical synthesis 
or biological activity is going on in support of restricted geometry, it is of 
interest to inquire if the above mentioned behaviors will be modified by the 
presence of such a support, or even whether they will subsist at all. 

To account for this type of complexity in low-dimension, we have to face 
some difficulties : 

• We have to consider nonlinear reactions involving at least two chemical 
species. 

• To maintain the chemical system out of equilibrium, we have to deal 
with open reacting systems. This forces one to consider lattices with 
empty sites and to fulfil a conservation relation of the number of sites. 
Nonequilibrium conditions are typically associated with adsorption and 
desorption mechanisms. 

• The flux between the substrate and the surrounding fluid leads to a spe- 
cific structure of the MF equation which has no analogue in the fluid- 
phase macroscopic description. 

The development of minimal lattice models satisfying these requirements 
and giving rise to instabilities will be illustrated in the case of periodic phe- 
nomena. We consider two reactants, Xi and X 2 , capable of undergoing an 
autocatalytic transformation once on a surface: Xi and X 2 may react via a 
bimolecular step when found in adjacent sites, Xi may adsorb provided that 
a free site is already surrounded by an adsorbed Xi , and X 2 may desorb if it 



has one free site in its vicinity [16]. 
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This scheme describes an open reactive system under nonequilibrium con- 
straints. Moreover it satisfies automatically the condition of conservation, the 
number of sites -f 2:2 + s = 1 where xi, X 2 and s stand for the fractional 
coverages. 

The corresponding MF equations admit 4 steady-states [16]: one trivial 
- the empty lattice, two semi- tri vials corresponding to the lattice poisoned 
by Xi or X 2 and one non-trivial steady state which is a center (see Fig. 
3). The MF behavior is found to be of the Lotka-Volterra type: a contin- 
uum of periodic oscillations whose period depends on the amplitude. For 
small amplitude oscillations the frequency tends to the linearized frequency 
u = {kik 2 kzl{k\ + k 2 + associated with the oscillations around the 
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poisoned by 




Fig. 3. Phase portrait of the lattice Lotka-Volterra for the choice ki = k 2 = ki = 1 
of parameter values. The heavy arrows represent the stable and unstable manifolds 
of the three saddles. 



center. Since the least fluctuation would make the system jump between tra- 
jectories with a change of frequency, this model does not adequately describe 
oscillations arising in fluid-phase systems. 

We first present the MC simulation results on a regular Id lattice (2 near- 
est neighbors). Starting from a random initial condition with equal coverage 
(a;i = X 2 = s = 1/3-, L = 2^®), one ends with the poisoning of the surface by 
Xi, or by X 2 , or with complete desorption. Nevertheless, during the transient 
stage the system reaches a quasi-steady state level as shown in Fig. 4, which 
may persist for very long times. For a time as long as 10‘* time units, 20% 
of realizations remain in such an intermediate state. These results are very 
different from the behavior predicted by the mean-field equations, where a 
marginally stable non-trivial steady state corresponding to xi* = X 2 s = 1/3 
is surrounded by periodic trajectories: not only does the periodic behavior 
around the center disappear through the spatial coupling, but the stability 
of the center itself is destroyed and the system eventually stabilizes to one of 
the trivial steady states. 

To understand the spatial organization during the transient evolution and 
in the steady-state, we have computed the nearest-neighbor covariance 

^ ^'^^r(t)cxr+e{t) ( 6 ) 

T 

where <7^ takes the values (0,— 1,1) if the site is occupied by a 5, Xi or X 2 
particle respectively. The sum runs over all the lattice sites and i represents 
the nearest neighbor. A random distribution of the three species with equal 
coverage implies F = 0. A non-vanishing positive value of V corresponds to 
the formation of clusters of homologous particles as in the transient config- 
uration of Fig. 4. Decomposition and reassembly of clusters may occur but 
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Fig. 4. Temporal behavior of the lat- 
tice Lotka-Volterra model in Id sub- 
strate for a typicaJ realization: xi (cir- 
cles), X 2 (squares), and s (diamonds). 
The curve with the triangles describes 
the time evolution of the nearest- 
neighbor covariance V{t). 




sites 



Fig. 5. Space-time plot of one real- 
ization for the one-dimensionaJ lattice. 
The white, grey, and black regions de- 
note, respectively, occupation by S, Xj 
and Xi. 



the overall picture remains invariant. Another visualization of the spatial or- 
ganization is provided by the space-time plot (see Fig. 5). In this realization, 
one starts (upper line) with a random occupation and a mean coverage of 
1/3 for each of the species and one observe formation and decomposition of 
clusters. The straight lines between different clusters reflect the existence of 
propagating waves of activity, due in turn to the fact that the reaction occurs 
only at the interface separating the clusters of different species. 

For a 2d square lattice, the situation is completely different. We observe 
temporal oscillations of the global coverage as predicted by the MF descrip- 
tion. The periodic behavior is robust under a wide choice of initial conditions 
provided one does not start too close to the trivial state. It seems therefore 
that the spatial interactions arising by the presence of the substrate act like 
a stabilizing factor. When increasing the lattice size; the amplitude of the 
oscillation of the overall coverage is reduced. On the other hand if we locally 
observe the system, by selecting a smaller part of the system, we still obtain 
the concentration oscillations around the center (see Fig. 6). Oscillations are 
therefore not merely a finite size effet. 

The nature of the 2d oscillatory behavior can be interpreted by analyzing 
the statistical properties of the data generated by the MC simulations. The 
nearest-neighbor covariance V(t) calculated on a substrate of size 2® x 2® 
presents the same oscillatory characteristics as the reactant fractional cover- 
age. This means that neighboring particles oscillate in phase. Morevover the 
correlation length estimated by computing the spatial correlation function 
covers several layers. This indicates that the nearest-neighbors of a “refer- 
ence” site are occupied by homologous particles. The existence of a fixed 
intrinsic size of clusters occupied by homologous particles reflects the un- 
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Fig. 6. Evolution of the global cov- 
erage as a function of time on a 2^ x 2^ 
square lattice (solid line) and on a sub- 
lattice of size 2® X 2® (dashed line). Pa- 
rameter values axe fci = A :2 = A:a = 1. 




Fig. 7. Histogram of the Xi and X 2 
coverage for a 2® x 2® lattice generated 
by a single realization over 10® time 
units. Parameter values Eire ki = k2 = 
kz = 0.25. 



derlying spatial organization of the system and suggests that the periodic 
behavior is associated with localized oscillations. Ordinarily the synchroniza- 
tion of local oscillators at the scale of the system as a whole is secured by 
diffusion [17]. In the modelisation developed here the only transport mecha- 
nism is associated with the “color” propagation due to the reactive dynamics. 





Fig. 8. (a) Normalized time-correlation function of X 2 species generated by a MC 
simulation. The solid line corresponds to the global coverage xz over a 2^ x 2^ lattice, 
the dashed and dotted over sublattices of size 2® x 2® and 2® x 2®, respectively, (b) 
Corresponding power spectrum for the Isirge system. Same parameters as in Fig. 6. 



To characterize the temporal coherence within the system we have com- 
puted the coarse-grained time-correlation function of the X 2 coverage over 
the entire lattice and over sublattices of different sizes [16]. As shown in Fig. 
8(a), the functions normalized by the corresponding covariances are nearly 
undistinguishable. This means that the time coherence is maintained at the 
level of the variable scaled by the square root of the variance. Figure 8(b) 
depicts the power spectrum associated to the correlation function. In partic- 
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ular, we see that the system exhibits a single preferred frequency, which is 
found to be size-independent. This result is rather unexpected in view of the 
existence of a continuum of equally dominant frequencies in the mean-field 
limit. Everything happens, therefore, as if the spatial coupling induces the 
entrainment of the local oscillators into a single, dominant frequency which is 
precisely the linearized frequency w associated with small oscillations around 
the center. 

A plausible explanation of this result is suggested by Fig. 7, where the 
3-dimensional histogram of Xi,X 2 is plotted. We see that the system realizes 
asymptotically a one-hump distribution centered on the non-trivial state. On 
this basis one may conclude that there is an amplitude selection of the tra- 
jectories and hence implicitly, through it, a frequency selection as well since 
small amplitude trajectories exhibiting the linearized frequency are predom- 
inant. There is no evidence of limit cycle behavior that could be expected 
from the existence of a preferred frequency, since in such a case one should 
obtain a crater-like probability surface. 

The analysis of the dynamics of a lattice Lotka-Volterra model on re- 
stricted geometry supports reveals once more the limitations of a MF de- 
scription. In Id, the oscillatory behavior disappears while a nontrivial spatial 
organization is observed [18]. For the same model on a 2d support, the lattice 
dynamics selects a preferred frequency which is shown to depend on the in- 
trinsic parameters and on the lattice geometry [16] . In the case of oscillatory 
dynamics, we have thus highlighted the drastic influence of spatial restric- 
tions imposed by local surface constraints on chemical reactions. It would be 
interesting to investigate the effects of the support on more complex nonlinear 
dynamics showing limit cycle and chaotic behavior in the MF limit. 

4 Perspectives 

The results presented in this paper suggest that the dynamical behavior gen- 
erated by a reactive system is highly sensitive to the substrate on which the 
reactions are taking place. This in turn leads, under certain conditions, to 
marked deviations from mean- field predictions. 

In view of the nanometric scale of the spatio-temporal patterns observed 
experimentally a mesoscopic approach appears to be necessary to describe 
such phenomena. For instance, wave-like behavior observed in the NO re- 
duction on Pt tips involves a few hundred particles [2]. In particular, the 
spontaneous formation of clusters of adsorbed particles is directly related to 
inhomogeneous fluctuations occurring on the surface [19]. The MF models, 
including reaction-diffusion equations, are becoming questionable to analyze 
spatio-temporal distribution of adsorbed reactants on the nanometer scale 
because they operate with average coverages of surface phases [20]. In this 
respect the development of new Monte Carlo methods incorporating the most 
relevant interactions between adsorbates is a challenging problem for bridging 
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the length and time scales between the mesoscopic level and the experimental 
observations. 

Surface diffusion allowing atoms to move on vacant sites has certainly to 
be included in a mesoscopic modelling of surface reactions. In low dimensional 
substrates, diffusion appears as a limiting mechanism and the question thus 
arises about its efficiency as a homogenizing process. It would be important to 
assess the respective roles played by diffusive transport and the propagation 
mechanism induced by the reactive dynamics. 

Most of the industrial catalytic supports in industrial-scale processes are 
porous media (compacted powder, zeolite) which are characterized by an 
interpenetrating array of different sized pores (macro-, meso-, and micro- 
pores) . An important issue for future work is certainly to describe adequately 
the various transport mechanisms arising in such structures ranging from 
bulk, surface and Knudsen diffusions. 
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in Nematics Driven by Multiplicative Noise 
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Abstract. We describe pattern formation due to electrohydrodynamic convection 
in nematic liquid crystals driven by a stochastic electric voltage. If the character- 
istic times of the system are well separated from the correlation time of the noise, 
the onset of the roll pattern is sharp, similar to the case of deterministic driving. If 
these times are comparable as it is typical for pure stochastic driving one observes 
outbursts of spatially regular roll pattern which interrupt quiescent (laminar) pe- 
riods. At the sample stability threshold the distribution of laminar periods is a 
power law with exponent —3/2 over several decades. We thus have a first example 
of on-off intermittency in a spatially extended dissipative system. 



1 Introduction 

Structure formation in spatially extended dissipative systems is a typical 
threshold phenomenon. Below a critical strength (the threshold) of a driving 
force the homogeneous state is stable and above this threshold random fluctu- 
ations, typically of thermal origin, are amplified and a certain mode becomes 
the winner of a competition thus forming a certain structure, a pattern. 

If the driving force is stationary the threshold is found by linear stabil- 
ity analysis; below threshold the amplitude of a given test mode decays to 
zero whereas above threshold it diverges to infinity. For periodic driving the 
generalization using Floquet theory is straightforward. 

For stochastic driving the situation is more complicated. Mathematics of- 
fers several stability criteria of stochastically driven dynamical systems, for 
example the stability of the pth moment (p = 1 stability of the mean, p = 2 
energetic stability), sample stability, etc. It is a priori not clear what stochas- 
tic stability criterion applies best to a given physical situation. Intuitively one 
expects that the answer could depend on the characteristic time scales both 
of the driving stochastic process Tstoch and of the physical system Tgys. 

If the driving process is fast against the characteristic times of the system, 
the system will ‘feel’ only the average of the driving process and all different 
criteria should give the same result as the deterministic criterion. 

If Tstoch and Tsys are of the same order, the system feels the driving pro- 
cess more sensitively. At the threshold the trajectory of the system neither 
diverges to infinity nor converges to zero. Processes of this type may be char- 
acterized by the statistics of the duration of periods where the trajectory is 



J.A. Freund and T. Poschel (Eds.): LNP 557, pp. 304-315, 2000. 
(c) Springer- Verlag Berlin Heidelberg 2000 




On-ofF intermittency and stochastic stability in nematics 305 

below, respectively above an arbitrary treshold. For a broad class of stochas- 
tic processes it is known that the distribution of these times is a power law 
with characteristic exponent —3/2. In our context, the period in which the 
trajectory is above the threshold is called ‘on-state’, if the trajectory is be- 
low threshold it is called ‘off-state’; the whole phenomenon is called on-off 
intermittency. 

This contribution introducing into our original papers [1,2] is organized 
as follows: We first describe the physical mechanism of pattern formation in 
nematic liquid crystals. In the next section the model equations describing 
the stability against formation of rolls and a formal solution are presented. 
Then, stochastic stability criteria are discussed and finally the relation of 
on-off intermittency and stochastic stability is examined. 

2 Roll Patterns in Sandwich Cells 

A sandwich cell formed by two planar parallel transparent electrodes is filled 
with nematics and an homogeneous, possibly time-dependent electric field 
E{t) is applied across the probe. The mechanism for structure formation 
depends crucially on the anisotropy of the electric conductivity of the nematic 
material. 

Without field (and for weak enough field E < Ec) the director field of 
the nematics is aligned parallel to the electrodes (quiescent state). In the 
presence of an electric field a distortion of the director field leads to a forma- 
tion of space charges which reinforce a destabilizing torque competing with 
stabilizing torques of, e.g., elastic origin which aim to restore the quiescent 
state. Above a threshold of the electric field Ec the quiescent state is desta- 
bilized and a hydrodynamic flow establishes forming a certain flow pattern 
(Carr-Helfrich mechanism) . The first pattern in a hierarchy of patterns of in- 
creasing complexity observed with increasing strength of the driving electric 
field are parallel rolls (see Fig. 1). The pattern characteristics depend on the 
parameters of the driving field such as strength, frequency, etc. which can 
easily be tuned. 

Due to the anisotropic optical properties the rolls lead to a pattern of 
parallel stripes in transmitted light which can be observed, e.g. with a mi- 
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Fig. 1. Formation of rolls in a sandwich cell. For E < Ec the director field is 
homogeneously aligned parallel to the plates {left). For E > Ec the hydrodynamic 
flow forms roll cells and the director field is periodically distorted (right) 
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croscope. A review of recent results about electrohydrodynamic convection 
in nematics is given in [3]. 



3 The Model Equations and Its Formal Solution 



The usual way to determine a threshold is to linearize the basic equations, in 
our case the nemato-electrohydrodynamic equations, and insert a test mode 
characterized by an amplitude and wave numbers. Thus we pass from a sys- 
tem of nonlinear partial differential equations to a system of linear ordinary 
differential equations. The threshold is found by the condition that below 
threshold the amplitude of the test mode converges to zero and above thresh- 
old it diverges to infinity. The wave number of the ‘winning pattern’ is that 
one which gives the lowest threshold. 

The so-called two-dimensional (2d) theory is obtained as follows. The 
anisotropy axis of the system is parallel to x, and all field variables are sup- 
posed to vary only in x and z. In the horizontal directions with infinite ex- 
tent a Fourier transformation (wavenumber kx) is applied; with respect to the 
transverse direction one Galerkin mode (with wavenumber fcj x it jd) for each 
field (velocity, director etc) is used. Their choice is dictated by the boundary 
conditions at the confining horizontal plates. Using stress-free boundary con- 
ditions the director distortions, the induced space charge, and the quantities 

dzVx{z) have to vanish at the boundaries, where Vx, denote the velocity 
components parallel and perpendicular to the confining plates, respectively. 
The velocity field can then be adiabatically eliminated because of the small 
viscous time scale. Setting kz —0 one obtains a one-dimensional (Id) version 
which is sometimes used for its simplicity. For a quantitative comparison with 
experiment the 2d theory is preferrable. 

This procedure leads to a system of two ordinary differential equations 
[4], describing the dynamics of the space charge q and the spatial variation 
of the angle 6 between the director and electrode plates, tp = dxd, 



where z = {q,ip)'^, and 



z = C{t)z, 



( 1 ) 



C{t) = - 



( 1/^9 \ 

aEt ) • 



( 2 ) 



All parameters in (2) depend on material properties and on the wave numbers 
kx and kz', the reader may find explicit expressions in [1,3]. 

For any realization of an electric field Et jumping between two values 
E'^ ,a = ±, at times t,,, u = 0, 1, . . . , n, where > tn-i > • ■ ■ > ti > to 
a formal solution of (2) can be obtained in the following way (note that the 
may be equidistant or randomly distributed, cf. Fig. 2). We first consider 
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Fig. 2. Periodic square wave (left) and a realization of a stochastic square wave, 
for example, of a dichotomous Markovian process (right) 



a time interval between two jumps where C(t) = C‘^ = const, a = ± and 
diagonalize by a unitary transformation 

U<rc- (u-)-i = ^ = diag (AH . (3) 

Introducing W'^ = U'^z one finds W'^ = diag(Af)W'^ which is solved by 
W^(t) = diag {exp [Af (t - t')]} The inverse transformation leads to 

z,(t) = T‘^(t-t')z,(t'), (4) 

where is the time evolution matrix 

T"(r) = (U")-' diag[exp(Af r)]U^ (5) 

For a given realization of the driving process with jumps at the times 
iteration of (4) gives the formal solution [1] 

Z<r„ (t) = T^"(f -in) ■■■ T"'(<2 - - to);S^o(*o). (6) 

If Et is a periodic square wave, all At^ = U+i — tu are equal and the stability 
is determined by the eigenvalues of (At^)T~'^ (At^) reproducing the result 
of Floquet stability analysis. 

If Et is a stochastic square wave, i.e. the At^, are randomly distributed, 
the stability of the stochastic trajectory z„^ (t) is determined by the largest 
Lyapunov exponent Ai of the product of random matrices in (6) in the limit 
n 00 . If this exponent has a positive real part the trajectory diverges, 
otherwise it converges to zero. The evaluation of infinite products of random 
matrices is a notorious difficult problem, which appears also in a number of 
different fields in statistical physics (cf. [5], for further references see, e.g., 
[1]). Equation (6) is used for the numerical simulations in order to determine 
stability thresholds [1] and the probability density of the duration of quiescent 
periods [2]. 

4 Stochastic Stability 

Stochastic stability criteria depend in general on the nature of the driving 
stochastic process. Since the square of the stochastic field enters (2), the use of 
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Gaussian white noise is excluded. The simplest process with a finite correla- 
tion time is the dichotomous Markovian process (DMP) which takes randomly 
the values ±E and has the autocorrelation exp[-2o:(t - 

t')]. a determines the inverse correlation time (i.e. Tgtoch = l/2a) and de- 
scribes the mean number of jumps in unit time. The times At between two 
consecutive jumps are distributed like o;exp(— aZlt). This process has gentle 
mathematical properties and is easily generated in experiment. We consider 
in the following an electric field Ef = £det + which is the superposi- 

tion of a constant component JS^et and a dichotomous Markovian component 

^DMP 

If the characteristic time of the driving stochastic process is fast compared 
to all other characteristic times the system will ‘feel’ only the average value 
of the stochastic field Et -t (Et) = £det, -> {Ef) = -I- E"^. This 

physical picture corresponds to a simple mean-field type decoupling of the 
averages {Etz) -> {Et)(z). With these replacements in (2) one obtains from 
det C = 0 the threshold 



jp2 

^det,th 



Ai - A^E^ 
(THOTg -t- yl2 ’ 



( 7 ) 



which increases (yl 2 < 0) in a linear way with the strength of the stochastic 
field [6i7]. In this approximation it is therefore impossible to explain 
neither the experimentally found discontinuous behaviour of the threshold 
[8,9] nor the dependence on the correlation time of the noise [9]. 

The stability of moments is determined as follows. The equations of mo- 
tions for the first moments form a closed system for (z) and One 

uses a theorem [10] 4- 2a){Ef^^ z) — {Ef^^z), replaces z by (1) and 

exploits in addition = E^ = const. Similar equations hold for the 

higher moments. The exact threshold condition for the stability of moments 
is nonlinear in the field strength thus opening the possibility for a qualitative 
(though not quantitative) understanding of the behaviour of the threshold 
[ 11 ]. 

To determine the asymptotic stability of the trajectory (6) for almost 
all realizations of the driving process, i.e. the sample stability, a standard 
method [12] is applicable to our system of two coupled stochastic equations 
(1) which circumvents the difficulties in evaluating the infinite product of 
random matrices. The first step is a transformation from to polar co- 

ordinates (r, (p), which leads from (1) to the skew symmetric system 



r=g{Et,(p)r, (8) 

(f = h{Et,<p), (9) 



explicite expressions for g and h are given in [1] depending on the same 
parameters as (2). Equation (9) depends only on ip and it is possible to find 
the stationary solution Et iv) of the associated Kolmogorov forward equation 
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for the joint process 

P, = -^{KPa) + a{P-.-P.),(^ = ±, ( 10 ) 

where is a shorthand notation for h(E^,(p). Equation (8) is linear in r and 
can be solved for a given trajectory of the driving process. This leads to an 
expression for the leading Lyapunov exponent 

Ai = lim j [dTg{Er,(p) = [ Pa{p)g{Ea,p). (11) 

* Jo Jsupp 



The second equality holds due to the multiplicative ergodic theorem of Os- 
eledec [13] with Prob 1, i.e., for almost all trajectories. 

For the nondegenerate (the matrices C+ and C“ do not have an eigen- 
vector in common) and nonrotational (the eigenvalues of C”' are real and 
distinct) case which is of interest here, Ai can be found up to quadratures 



cr = ± 



LppdpF-^\n\h+/h- 

Jsupp dpF/h+ 



( 12 ) 



where 



F{<p, ‘Po) = exp j^-a J dp -b , 



po e supp. 



(13) 



For pure stochastic excitation (£?det = 0), the quadratures in (12) and (13) 
can be evaluated explicitly in terms of generalized hypergeometric functions 
both for the Id [14] and 2d model [1]. Also for a constant, finite field E^et an- 
alytical results exist for the Id model, whereas for the 2d model the integrals 
in (12) and (13) were evaluated numerically [1]. 

The two Lyapunov exponents of the system Ai > A 2 are related by 



Ai +A 2 = 1/2 Y, SpC^ 



(14) 



The threshold is defined by Ai = 0; the corresponding characteristic time ri = 
|l/Ai| diverges and is thus well separated from Tstoch = l/2a. At threshold 
we have an explicit expression for the second characteristic time 

T2 = |1/A2| = (1/T, + Ai-A2(F;L + -E"))“\ (15) 

which decreases with increasing values of the threshold fields and with in- 
creasing wave number of the pattern and may reach the order of Tstoch- 
If T 2 ~ Tstoch, the mean-field decoupling is obviously not justified and the 
threshold obtained from the stability of the moments differs quantitatively 
from the sample-stability threshold, cf. Fig. 3. In this regime one observes in 
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Fig. 3. Thresholds for the appearance of normal rolls calculated in the Id model for 
a superposition of constant voltage Ui and a fast stochastic dichotomous voltage U 
(a ~ 1000 s“^) obtained from mean-field decoupling (dashed line), stability of first 
moments (dash-dotted line), sample stability (solid line), and numerical simulation 
(•). On the right side, the characteristic time T 2 is shown as a function of the 
stochastic voltage U. The initially clearly separated time scales of T 2 and Tstoch 
become of the same order at sufficiently high U. The insert shows the case of a 
’slow’ stochastic voltage (q ~ 100 s“*) where the time scales are well separated 
(from [1]) 

experiment intermittent bursts of a regular spatial stripe pattern interrupt- 
ing the quiescent state which makes a naive determination of the stochastic 
threshold difficult [15]. As described below, the statistics of the duration of 
quiescent periods becomes just at the sample stability threshold a power law 
with characteristic exponent -3/2 as it is typical for on-off intermittency. 

5 On-OfF Intermittency 

Dynamical systems at a stability threshold driven by a multiplicative, ir- 
regular, i.e. stochastic or chaotic process may exhibit a new type of inter- 
mittency characterized by specific statistical properties of the intermittent 
signal. Laminar periods (‘off-states’) are interrupted by bursts of large varia- 
tion (‘on-states’), therefore the name ‘on-off intermittency’ was coined in [16]. 
The duration of laminar periods is governed by power laws with exponents 
universal over a broad class of different systems. Early studies considered 
models with only few degrees of freedom described by differential equations 
[17] or mappings [16]; experimental realizations are found, e.g., in nonlinear 
electrical circuits. 

A model system which can be treated to a large extent analytically [16] 
is the random logistic map, 

2/n+l — ^n2/n(l 2/n)) ^ — 6, 1, 2, ... , (fb) 

where Zn = a^„; being a random variable with uniform distribution in [0, 1] 
and o > 1. We briefly sketch the line of reasoning given in [16]. The stability 
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of the fixed point y = 0 is determined looking at the linearized iterative 
solution of (16), t/n = YYjZl Taking the logarithm, one is led to an 
additive random walk, s„ = where s„ = ln(?/„) and = ln(z„). 

The condition (g„) = 0 defines the threshold a — e. The length of a laminar 
period is the number of steps for which the random walk s„ stays below a 
small arbitrary threshold. At a = e the probability to find a laminar period 
of length n is found analytically to scale like [18] 

A{n) . (17) 

Above threshold = o — e > 0 the power law has exponential corrections. To 
leading order in 6 one finds 

A(n) ~ e/(2v^)exp [— nJ^/(2e^)] (18) 

This defines a critical length tie = 2e^/8‘^ below which the power law domi- 
nates and above which the exponential decay dominates. The average of the 
laminar phases (n) is apart from an additive constant a power law ~ e^/2 5“^. 
As might be inferred from this short outline, the thus obtained universal be- 
haviour is deeply connected with the possibility to discuss the linearized 
equation. 

More recently, on-off intermittency was described theoretically in model 
systems with many degrees of freedom [19], such as random map lattices 
[20], larger systems of coupled nonlinear elements [21], and partial differential 
equations [21,22]. In [2] we have first reported about on-off intermittency in 
nematic liquid crystals driven by a stochastic voltage and found quantitative 
agreement of theory and experiment. 

For simplicity we restricted ourself to the simplest case of pure stochas- 
tic driving, Ejet = 0. In Fig. 4 thresholds and wavenumbers are shown as 
function of the (mean) frequency i/ = a/2 of the driving process both for a 
determinstic and a stochastic square wave. For periodic driving, one finds a 
typical frequency dependent threshold voltage Uc {U = Ed) for the stability 
against formation of normal rolls. There is a sharp transition at Uc = 38 
Hz between the conductive regime (oscillating space charges) characterized 
by a wavenumber k it/ d and the dielectric regime (oscillating director 
deflections), where is an order of magnitude larger. 

For stochastic driving, one observes bursts of stripe pattern uniform across 
the system. Since the stochastic voltage has a broad frequency spectrum 
which contains low frequency contributions one expects occasional bursts al- 
ready above the DC threshold (i/ = 0 in Fig. 4) the threshold for a periodic 
voltage of the same frequency. With increasing voltage the frequency of the 
bursts increases. Figure 5 shows the trajectories of a suitably defined pattern 
intensity for different voltages. Figures 6 and 7 compare the experimen- 
tally determined distributions of laminar periods p(r) with those obtained 
from simulations of the linearized nemato-electrohydrodynamic equations in 
the conductive {u = 60 Hz) and dielectric {v = 180 Hz) regimes, respectively. 
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Fig. 4. Thresholds and wave numbers for driving with square waves of (mean) 
frequency v = q/ 2. Experiment (diamonds: periodic case; circles and triangles cor- 
respond to a ratio of 75% and 25% of laminar phases in the stochastic case) is 
compared with theory (full line: periodic case; dotted line: sample stability thresh- 
olds stochastic case). The full squares at = 60 Hz and 180 Hz indicate the voltages 
for which the experimentally determined distribution of laminar periods is best de- 
scribed by a law (from [2]) 



The experimental histograms contain data from about 2500 bursts of <Trei(^)- 
The threshold is the voltage for which the distribution of laminar periods is 
best described by a law; cf. the full squares in Fig. 4. It is well below the 
threshold for a periodic voltage of the same frequency. Deviations from the 
power law occur for very small r due to the finite time resolution and for very 




0 300 600 t [s] 



Fig. 5. Bursts of the intensity modulation (Trei(t) in the conductive regime (a) just 
at the threshold and (b) 0.3 V above threshold for identical trajectories of the DMP 
which makes about 9 x 10^ jumps in the period shown {v = 60 Hz). The dashed 
lines indicate uiam. For (Xrei > criam the system is in the on-state, otherwise in the 
off-state (from [2]) 
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Fig. 6. Distribution p(r) in the conductive regime, (a) Experiments for U = 14.6 
V (squares) and 15.3 V (triangles), and (b) simulations for U = 18.2 V (full line) 
and 19.0 V (dashed line) using — 1484 cm“^ (from [2]) 



P 

10 '^ 
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Fig. 7. Distribution p(r) in the dielectric regime, (a) Experiments for U = 76.0 V 
(circles), 79.5 V (squares), and 83.0 V (triangles), and (b) simulations for U = 82.0 
V (dotted line), 84.9 V (full line), and 90.0 V (dashed line) using kx = 7670 cm~'^. 
The dash-dotted line is a —3/2 power law (from [2]) 



large r due to the background fluctuations from thermal noise. Increasing the 
amplitude beyond the critical voltage leads to exponential corrections to the 
power law as discussed above. Increasing the voltage further, the system does 
not reach a state of permanent convection, instead the patterns become more 
and more spatially irregular while keeping its intermittent character. 

The numerical simulation uses (6) to generate trajectories z{t) starting 
from a small nonzero initial value z{to)', the wave number found by mode se- 
lection for the given parameter setting is inserted as a parameter. To model 
the background of thermal fluctuations of ijj we introduced a lower cutoff 
V’min, be. Ip -> ^AminSgu^ for \tp\ < ipmin- In the dielectric regime we addition- 
ally reset q in a similar way. A trajectory is considered laminar as long as 
IV'I is smaller than a given threshold V'lam = 2 x lO^V’min- At Uc the distri- 
bution is a power law over several orders of r with deviations for very 
small and very large t as in the experiment, cf. Figs. 6b and 7b. The range 
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of validity of the power law increases when ■0min/'0iam is lowered. Also for 
voltages smaller or larger than Uc the shape of the simulated distributions is 
very similar to that obtained in experiment. The shoulder for large r becomes 
more pronounced for voltages below the critical voltage. 

To distinguish between effects due to thermal fluctuations and due to a 
deviation from the stability threshold AU = U - Uc we have also performed 
simulations with V'min = which is obviously too small for compar- 

ison with experiment. At Uc the power law holds then over 8 decades. Above 
threshold the results agree very well with p ~ exp(— const and 

the mean duration of laminar periods behaves like (r) ~ AU~^ as for the 
simple model discussed above. 

We have described on-off intermittency in a spatially extended dissi- 
pative system driven by multiplicative noise with the same scaling laws 
as for the simple, analytically tractable model (16). Pattern formation is 
however a problem with truly many degrees of freedom. The key for un- 
derstanding is the observation that between two jumps of the driving pro- 
cess (9) can be integrated. Inserting this, one can solve (8) by iteration, 
r{tn) = n"=i which is of the same form as the linearized 

solution of (16). Note, that (InG) = 0 is just the threshold condition of the 
sample stability criterion. The Gp however, have more complex statistical 
properties than the z„ in (16). One should argue that the derivation of the 
scaling behaviour is extendable to more complicated cases (also for chaotic 
driving one finds the same law). A further ingredient is, that in the param- 
eter region we have investigated a single wave number is preferred. At the 
transition between the conductive and the dielectric regime mentioned above, 
it may be however hard to decide between two wave numbers and effects of 
dynamical mode selection could become relevant. 
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Abstract. We formulate, solve, and examine an elementary model of gated ab- 
sorption, where the reactivity of a sphere fluctuates in time, in the context of 
Smolukowski’s diffusion-controlled rate processes. Interest in this problem was stim- 
ulated by some experiments on biomolecular rate processes in the 1970s. The model 
under discussion here was studied by a number of investigators in the 1980s, and 
interest is renewed by the discovery of resonant activation in the 1990s. We find that 
the simplest gated reaction process does not exhibit features characteristic of reso- 
nant activation, although some interesting nonequilibrium correlations may have a 
quantitative effect in some situations. We speculate on the possible appearance of 
resonant activation phenomena in related processes. 



1 Introduction 

Resonant activation [1] is a nonlinear nonequilibrium phenomenon involv- 
ing the emergence of correlations between ostensibly independent processes. 
Consider a stochastically perturbed particle crossing a potential barrier de- 
scribed by a Kramers type activation process [2]. In the overdamped limit 
when the barrier is high compared to the particle’s diffusion coefficient, the 
typical escape time depends exponentially on the ratio, i.e., T^scape ~ 

Now consider a temporally fluctuating potential barrier where the varia- 
tions are an externally controlled process so that the particle state does 
not affect the barrier changes (the set-up is now strictly nonequilibrium). 
Suppose the barrier fluctuation time scale is TbarHer and, for simplicity, 
that the barrier fluctuates between Vmin and V^ax with an average {V). 
When the barrier fluctuations are slow relative to the longest relevant time 
scales in the system, so that Tbarrier > Tmax ~ then the average 

time to cross the barrier will be the average, Tgacape ~ which may 

be of the order of the longest time ~ On the other hand when 

'^barrier ^ '^min ^ gVAin/£> and the barrier fluctuations are fast compared 
to the barrier crossings, then the particle effectively moves in the average 
potential and we expect Tescape e<y)/D < 

These two limiting scales, ~ and ~ might reasonably 

thought to be the range of possible times for the barrier crossing process. 
But the phenomena of resonant activation shows otherwise. For some system 
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configurations it is possible that an even shorter barrier crossing time scale 
emerges at an intermediate time. Indeed, when TbarTier ^ T'min, then Tescape 
also « Tmin ~ What happens is that if the 

barrier remains “down” long enough for the particle to cross, then it does so 
in a typical time characteristic of the lowered barrier crossing. Strong cor- 
relations between the barrier variations and particle crossing events emerge 
when these time scales match up, correlations which are absent in either the 
fast or slow barrier fluctuation regime (see [1]). 

This effect and related phenomena have been studied from a great number 
of points of view ([3]-[12]). Most recently a thorough experimental study 
[13] both observed resonant activation directly and, moreover, measured the 
complete escape time distribution for various regimes of barrier fluctuation 
time scales. 

Activated rate processes in nonequilibrium systems like glasses [14] and 
biomolecules [15] provide ample motivation for considering such complex 
stochastic dynamical processes. The fluctuating barrier scenario was hypoth- 
esized in particular for experiments in the 1970s on the reaction kinetics for 
hemoglobin rebinding of carbon monoxide and dioxygen [16]. In those exper- 
iments the “ligands” carbon monoxide and dioxygen were photodissociated, 
and then the ensuing diffusion-controlled rebinding process was monitored 
at a wide range of temperatures and, later, in a range of solvent viscosities 

[17] . The first attempt at modeling the effect of reaction rate fluctuations 
in such a diffusion-controlled ligand-to-protein binding process came in 1981 

[18] , which was soon followed by more intensive and general studies [19], 
[20]. Those theoretical investigation focused on the effect of surface reactiv- 
ity fluctuations on Smoluchowski’s diffusion-controlled rate theory ([21]-[23]). 
A re-examination of this model, with an eye towards the search for interesting 
phenomena like resonant activation, is the focus of this paper. 

In the next section we review the classical Smoluchowski theory in order 
to recount some of the basic modeling assumptions and introduce notation. 
Then in section 3 we generalize the model to include random fluctuations 
in the surface reactivity as a model of a gating process active at a protein 
surface. We solve the model in the steady state and point out some features of 
some limiting cases. The final section 4 is a discussion of the results and their 
implications for the relevance of resonant activation phenomena in complex 
systems like the protein-ligand binding reaction. 

2 Smoluchowski Theory 

for a Partially Absorbing Sphere 

We begin by recalling the classical theory of a partially absorbing sphere 
(the protein) of radius R at rest in a solvent filled with diffusing particles 
(ligands) at concentration C far away ([21]-[23]). By “partially absorbing” 
we mean that the sphere absorbs ligands impinging on the surface at a fixed 
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rate v < oo. The limit v oo, corresponding to a “perfectly absorbing” 
sphere, may and will be taken and examined at our convenience. We denote 
this surface reaction coefficient by v because it has units of velocity; roughly 
speaking it is the product of an intrisic reaction rate (units time~^) and a 
small length scale indicating how close the ligand must come to be absorbed 
(which might be thought of as the characteristic length scale of the ligand). 
For the spherically symmetric case that will concern us exclusively in this 
paper, the distribution of ligands external to the sphere is described by a 
density p{r, t). 

The dynamics of the ligand diffusion-reaction process is given by the dif- 
fusion equation 

dtp = ^drr^drp ( 1 ) 

where D is the ligand diffusion coefficient in solution and the differential 
operator is the radial part of the Laplacian in three dimensions. The boundary 
conditions are 

^^rp\r=R — '*^P\r=R ) ( 2 ) 

and 

lim p = C. (3) 

) — >oo 

The first boundary condition above states that the probability flux at the 
surface of the sphere is precisely v times the density at the surface. The total 
probability current through the entire surface at time t is thus 

J{t) = 4TrR^Ddrp(R, t) = vx inR'^piR, t). (4) 

The second boundary condition merely states that the ligand density far away 
is not affected by the reaction. This single-absorber theory is presumably a 
reasonable model for a sufficiently dilute solution of proteins in a sea of ligands 
in excess. 

In order to solve the evolution equations for all times we require some 
initial data. If the ligands are distributed uniformly outside the sphere at 
time t = 0, then the initial condition is simply 

p(r,0) = C. (5) 

The exact solution of this full time dependent problem is known [23], 
although the complete expression is not of direct use to us for the purposes 
of this discussion. The stationary solution will be useful for comparison with 
results in the next section, however. It is 

Note that at long times the ligand density is significantly modified for a 
distance of the order R from the sphere. For the extreme diffusion-limited case 
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where D/vR — >• 0, the ligand depletion zone is the most apparent. Near the 
reaction-limited situation where D/vR —> oo, the density is barely affected 
and remains almost constant up to the surface. The factor 1/{1 + D/vR) may 
be though of as an “efficiency factor” with regard to the relative importance 
of the surface reaction coefficient (v) and the ligand transport (D). 

The exact time-dependent result for the total probability flux at the sur- 
face is also of interest. It is 




J{t) = iirDRC 



X erfc 




( 7 ) 



The time-dependent probability flux yields the full time-varying survival 
probability curves of unligated proteins as measured directly in experiments 
such as those described in [16] and [17], Indeed, the probability that the 
sphere absorbs a particle during an interval dt at time t is just J{t)dt. Hence 
the probability that no ligand has been absorbed from time 0 up to time t is 

s{t)= n 



0<t'<t 



= n 









( 8 ) 



Not unexpectedly, the survival probability function S{t) based on (7) (called 
N{t) in [16] and [17]) has a complicated functional form in general. For the 
extreme diffusion-limited case where D/vR -)• 0, however, it is tractable and 
somewhat illuminating. In that limit (7) reduces to 



J{t) = iirDRC I 1 + -7^) 



and the survival probability is given by 



S(t) 



_ ^-47r 



( 9 ) 



( 10 ) 



In any situation where a steady state for the ligand density is possible and 
J converges to a nonvanishing steady state current as t ->• oo, S{t) will have 
an asymptotic exponential tail at long times. For the case under consideration 
here, based on (7), 



hm J{t) = AttDRC X 

t->oo 14 --^ 



( 11 ) 
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so that by writing 

S{t) ~ = e"*^*^* (12) 

for long times, we identify the asymptotic Smoluchowski diffusion-controlled 
rate constant 

ks=iTTDRx (13) 

1 + ITr 

For the extreme diffusion-limited case where D/vR 0, ks ^ 4wDR. In the 
reaction- limited situation where D/vR > 1, the rate coefficient approaches 
the “mean field” value ks 4 ttR?v, the reactive area times the surface rate 
coefficient. 



3 Smoluchowski Theory for an Occasionally Partially 
Absorbing Sphere 



Consider an occasionally partially absorbing sphere of radius R at rest in 
a solvent filled with ligands at concentration C far away. By “occasionally 
partially absorbing” we mean that for part of the time the sphere absorbs 
ligands incident on the surface at a fixed rate v, and for the other part of the 
time the surface reflects the ligands. For convenience the transitions between 
the reacting and absorbing states will be described by a Markov process with 
lifetimes Ton and Toff in the reaction on and reaction off states respectively. 
The density of ligands external to the sphere is described by a two dimensional 
vector of densities, 



/ Pon{r,t) \ 
\Poff{r,t)J ’ 



(14) 



describing the time dependent spatial distribution when the sphere is in the 
on and off states. 

The dynamics of the model is given by the coupled diffusion equations 



dt 




^ '' 



( ^drV^dr - 
1 — ^drr'^dr — ) 

\ Ton ^ ' Tojj / 




(15) 



where D is the ligand diffusion coefficient in solution. The boundary condi- 
tions are 



and 



^9rPon\r—fi — '^Pon\j.—R> 

Ddj-Poff\j.— [i = 0, 




c 



T^on "b "^of f 



Joff . 



(16) 

( 17 ) 
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The coefficients of the ligand concentration C in the vector above are, re- 
spectively, the probabilities that the absorber is in the on or off state. 

The full time-dependent solution of the evolution equations requires initial 
data. If the ligands are initially distributed uniformly outside the sphere, and 
the phase of the on-off state of the absorber is random, then these initial 
conditions are 



Pon(r,0) 



C 



'^on '^off 



‘off ^ 



(18) 



A complete solution of the problem would yield the entire survival probability 
curves as measured in experiments like those described in [16] and [17]. The 
problem as stated in (15-18), and some closely related problems, have been 
investigated to some extent ([19], [20]) but no complete exact time-dependent 
solution has been derived to this author’s knowledge. In the remainder of 
this section we will restrict attention to the steady state solution, which 
corresponds to the exponential tail of the survival probability after the initial- 
distribution-dependent transients have died away. 

The solution to the stationary state of (15-17) is best deduced via a simple 
change of dependent variables. Let 



^{r)-rpon{r) + rpoff{r), 

= Toff r Pon{r) - Ton T Poff{r), 

which satisfy the distant boundary conditions 



#(r) 



= C, 



lim 

r—¥oo 

lim 3'(r) = 0. 

1 ►OO 



(19) 



(20) 



These variables satisfy the simple uncoupled constant coefficient equations 



0 = Dd^^ir), 

0 = Ddf^ir) - I — + — I !?(r). (21) 

'^off / 

The solutions satisfying the distant boundary conditions are 

^(r) = Cr A, 

^{r) = Be~^\ ( 22 ) 

where the coefficients A and B are to be determined by the boundary condi- 
tions at r = i?, and k,~^ is the scale of distance around the sphere where the 
density is modified in the presence of the surface reactivity fiuctuations: 




( 23 ) 
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Imposing the boundary conditions at the ocassionally partially absorbing 
surface at r = ii, we determine that 



A = 
B = 



-CRf, 

-CRf 



Toff 
1 + kR 



^kR 



where the “efficiency factor” / is 

r _ Ton(l + R-R) 

(1 + m) [M/ + + kR)] + ^ Toff ■ 



(24) 



(25) 



The total ligand density then takes on the particularly simple form 



p(r) = Ponir) + Poffir) = C 




(26) 



and the total probability current on the boundary of a sphere centered at the 
origin — corresponding to the exponential decay rate of the survival probabil- 
ity at long times — is 

J = fcC = i-KT^D^ = A-wDRCf. (27) 

or 

So the effective rate coefficient at long times is k = AnDRf, and all the 
effects of the reaction rate fluctuations are contained in the “renormalized” 
efficiency factor /. This, together with (25), is the fundamental result of the 
excercise. We now examine some limits where we may make contact with 
classical results and/or interpret the physical content of (27) and (25). 

First we check the limit of Ton! Toff oo where the sphere’s absorbtion 

process is almost always active, to find 

k ~ AtDR X — (28) 

in accord with the expression for Smoluchowski’s rate ks in (13). Next we 
consider the reaction-controlled limit where D/vR'> 1. Then 

k ~ AnR\ X — , (29) 

Ton T Toff 

an easily interpreted result: it is the reaction-controlled rate multiplicatively 
corrected by the fraction of the time (i.e., the probability) that the sphere is 
absorbing. This result suggests that in this limit, the gating process and the 
absorption events are statistically independent, as is typically the case in a 
mean-field situation. 

In the extreme diffusion-controlled limit where D/vR -> 0, we observe 
that 

k ~ AnDR X (30) 

Ton + 1 +k.R 
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which is not what one would expect based on simple averaging. Indeed, in 
the absence of reactivity fluctuations the limit is simply 4ttDR, so it might 
naturally be assumed that the renormalized rate should be, as it was in the 
reaction-iimited case in (29), the no-fluctuation rate times the fraction of 
time that the sphere is absorbing. But it is not. Because 

(31) 



> 



1+kR 



the actual rate is greater than the average rate predicted by naive intu- 
ition. This amplification of the simply averaged rate comes about because 
the gating process modifies the local ligand density near the surface of the 
sphere. The density near the surface grows during the off times, which leads 
to an enhanced probability current at the surface when the reaction becomes 
effective. This kind of anomalous behavior, where ostensibly independent 
processes exhibit some correlations, is characteristic of interesting nonequi- 
librium phenomena that includes effects like resonant activation. 

There is another limit where the interplay of spatial distribution of ligands 
with the fluctuations comes into play. Consider the limit To„/to// -> 0 where 
the absorbtion process is rarely active. Then 



k ~ iTrR^v X X 

Toff 



■1 I vR j_ / 

D V 



(32) 



which exhibits two distinct secondary limits depending on the relative size 
of the diffusion and fluctuation time scales. First, if T(,„ is small compared 
to the diffusion time scale R^/D then the spatial density around the sphere 
is not effectively perturbed from the reaction-free (uniform) distribution by 
the brief periods of absorption, and 

k ~ 4ttR^v X (33) 

Toff 



This is just the reaction-limited rate times the (small) fraction of time that the 
absorbtion process is active. However, vR/D need not be small to achieve this 
reaction-limited-like expression independent of the ligand diffusion coefficient 
D. On the other hand, if Tan is long compared to R? /D then the density near 
the sphere has time to reach its stationary distribution during times when 
the reaction is active. Then the rate coefficient is 

k ~ 4nRD X — ^ x — , (34) 

which is the diffusion-limited rate simply renormalized by the fraction of time 
that the reaction is in the on state. These particular limits, Ton! Toff — t 0 fol- 
lowed by either DtouIR^ ->■ 0 or Dtou/R? oo, are mean-field limits with 
an absence of correlations between the reaction and gating processes. Nev- 
ertheless it is interesting to observe how the reaction-limited and diffusion- 
controlled rates are recovered in these extremes. 
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4 Discussion 

In order to compare any of these models to, say, the kind of experiments 
reported in [16] or [17], the complete solution for J{t) is needed to compute 
the survival probability S{t). It is not altogether obvious just how a phe- 
nomenon like resonant activation would manifest itself in such a situation. 
But if we restrict attention to the time-asymptotic kinetics after transients 
have expired — which is all we have computed in the previous section — then 
the question becomes whether or not the effective rate coefficient exhibits 
a monotonic dependence on the gating frequency. This question can be ad- 
dressed directly by re-writing the efficiency factor / from (25) as 




where 

r= — + — (36) 

Ton Toff 

is identified as the overall switching rate. The effective rate coefficient is 
proportional to /, so any “resonance” effects would have to show up here. 
However, it is easy to see that / increases monotonically from 

1 1 

{1 + D/vR){l + Toff /Ton) 1 + D/vR + Toff/Ton 

as r varies from 0 to oo. Hence we are led to the conclusion that there is no 
such simple manifestation of resonant activation in this model. 

This result is not too surprising in hindsight, given some of the simple 
examples developed in [3] and [4] which do not exhibit resonant activation. 
Besides a fluctuating gate, another necessary ingredient for resonant activa- 
tion appears to be a “fast relaxation” mode which is fast but not instanta- 
neous. Such fast modes are “barrier-down” configurations which produce a 
nonzero time scale to which the barrier fluctuations may be matched for the 
resonant conditions. In the simple gated reaction studied here, the particle 
reacts essentially instantaneously (albeit with finite probability proportional 
to v) when the absorption event takes place. A generalization of the gated 
model, which likely would display resonant activation in the sense described 
here, is a Smoluchowski theory incorporating a fluctuating barrier near the 
reaction surface. A potential energy barrier is easily included in the basic 
theory where the diffusion equation to solve is 

4- Ddr'^ p (38) 

with boundary conditions 



^^rP\r=:R — T>bareP\r=R ’ 



( 39 ) 
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and 

lim p = C. (40) 

r— >oo 

In the above, V (r) is the potential energy, ^ is the ligand’s friction coefficient 
in solution (so the Einstein relation is D = ksT/Q, and Vbare is the “bare” 
surface reaction rate. After transients, the survival probability is S{t) ~ 
with rate coefficient 

k = 47rDi? X — , (41) 

R^ren 

where the renormalized surface reaction rate is 

1 ^g+V(r)/feBT _ ’ 

The challenge now is to generalize this model to include fluctuations in the 
barrier V{r). The mathematical tools are in place, the equations may be 
written down immediately. What remains is to solve them and study the 
solutions. 

Realistic protein kinetic models will likely involve a combination of ingre- 
dients like those discussed here: external ligand transport, multiple internal 
states and fluctuating barriers, and even fluctuations of the ligand diffusion 
coefficient to model variations in the local environment inside the protein. 
Such complicated models would have to be motivated by thorough knowl- 
edge of (or extremely brave speculations about) the structure and function 
of various components of the system. And most likely such complicated mod- 
els would have to be studied computationally. Simple analytically soluble 
models still play a role, however, as we build our understanding of complex 
systems in part by developing knowledge about the interesting dynamics of 
their components. 

Finally, we emphasize that it remains to examine the gated reaction pro- 
cess described in this paper as regards the full survival probability curve. It 
is quite possible that more profound qualitative effects may come into play. 
For example we see from the simplest survival probability curve in (10) that 
S{t) has a stretched exponential behavior at early times. The early square 
root time dependence comes from the rapid depletion of ligands starting out 
very close to the reaction sphere at the initial time. This is just a transient 
for the simplest process described here; S{t) crosses over to a simple expo- 
nential after a time ~ E? /D. With a gated reaction, however, the density 
can build up near reacting surface during “off” periods which may then pro- 
duce stretched exponential behavior (initially, at least) during “on” times. 
The question is, can such a mechanism produce a significant non-exponential 
behavior in the survival probability? The answer is contained in the full time 
dependent solution to equations (15-17). 
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Abstract. Noise induced phenomena are investigated in a physical system based 
on a tunnel diode. The stochastic differential equation describing this physical sys- 
tem is analog to the Langevin equation of an overdamped Brownian particle dif- 
fusing in a nonlinear potential. This simple and versatile physical system allows a 
series of experiments testing and clarifying the role of the noise and of its correlation 
in the stochastic dynamics of bistable or metastable systems. Experimental inves- 
tigations of stochastic resonance, resonant activation and noise enhanced stability 
are discussed. 

1 Introduction 

In the past two decades a lot of research efforts have been devoted to the the- 
oretical and experimental investigations of noise induced phenomena. Noise 
induced phenomena are observed in nonlinear systems in the presence of at 
least one source of randomness. The paradigmatic example of noise induced 
phenomena is stochastic resonance [1], Stochastic resonance is observed in 
a variety of systems and conditions [2,3], its essential aspects concern a 
bistable system, a driving signal (periodic or aperiodic [4]) and a source 
of randomness. Another widespread noise induced phenomenon is resonant 
activation [5] . Resonant activation may be observed when thermal activation 
of a metastable state occurs in the presence of stochastic fluctuations of the 
potential barrier height. In addition to these two prominent examples of noise 
induced phenomena several other effects have been recently investigated. Be- 
tween them we wish to draw the attention of the reader to the phenomenon 
of noise enhanced stability [6,7]. In this phenomenon the stability of an oth- 
erwise deterministically unstable system may be enhanced by the presence of 
a finite amount of noise. 

The study of noise induced phenomena has been carried out by perform- 
ing numerical and analogic simulations, theoretical and experimental inves- 
tigations. For example, theoretical studies of stochastic resonance have been 
performed by using conceptual frameworks as different as the linear response 
theory [8, 9] or information theory [10]. Experimental investigations have been 
performed on a variety of physical, biological and complex systems [3]. 

Each noise induced phenomenon is usually investigated in one specific 
system. However there exist a few number of versatile systems that allows 
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the investigation of a variety of noise induced phenomena in the same system. 
One of these physical systems is an electronic bistable system based on a 
tunnel diode. In such a system we have experimentally investigated stochastic 
resonance, resonant activation and noise enhanced stability. These are three 
examples of the counterintuitive role played by noise in the dynamics of a 
nonlinear physical system. 



2 The Physical System 



An Esaki diode [11], or tunnel diode, is used in our experiments. The Esaki 
diode is a highly doped semiconductor device which has a current-voltage 
characteristic curve showing a region of negative differential resistance. The 
series of a tunnel diode with a resistor constitutes a simple bistable system. 
This bistable system is characterized by two stable states (let us call them A 
and C) and an unstable state (let us call it B). The physical state associated 
to the stable and unstable states can be varied by varying the bias voltage 
applied to the series of the resistor and the tunnel diode. This physical sys- 
tem is described by a differential equation which is formally equivalent to the 
deterministic part of the Langevin equation describing an overdamped par- 
ticle. When the diode is in one of its stable states, variations in the applied 
voltage Vi, or the presence of noise let the diode to move towards the state of 
marginal stability B and to make a transition to the other stable state. The 
states A and C may be considered as states of local stability separated by a 
barrier AU. 

The role of the fluctuations in tunnel diode circuits and the problem 
of the metastability in a tunnel diode was investigated by R. Landauer, 
which discussed in his original paper distribution functions and jump rates 
of metastable states far from thermal equilibrium [12]. 

We model the resistor-diode system as an overdamped anharmonic oscil- 
lator characterized by a generalized potential U{x). In this model the diode 
voltage Vd stands for the particle coordinate a:. We use the current continuity 
equation i = id + ic to write the dynamical equation of the system 



dvd 

dt 



Vb - Vd 
RC 



c 



^ sin{uJst + 4>) 



( 1 ) 



where id = f{vd) is the diode current, and ic = Cdvd/dt is the capacitor 
current. The equation 



dU {vd, t) _ Vs sin(o;st + (p) Vi - Vd f{vd) 
dvd ~ RC ^ RC C 



defines the time-dependent generalized potential function U{vd,t) for our 
physical system. By using the diode characteristic f{vd) and integrating 
Eq.(2) with respect to the variable Vd, we obtain the generalized potential 
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function U (vj, t) . For the selected tunnel diode, the specific form of the gener- 
alized potential is controlled by the parameters Vj and R. By properly select- 
ing these parameters the potential barrier heights seen from the two stable 
states can be done equal mimicking an approximately symmetric bistable 
potential. For different values of the control parameters, the generalized po- 
tential can be made arbitrarily asymmetric. 

When one adds to the deterministic signals a noise voltage v„(t), with 
zero mean and variance V^ms^ equation of the circuit can be written as 
[12,13] 



dvd 

dt 



dU{vd,t) ^ 
dvd 



RC 



Vn(t). 



(3) 



This equation is analog to a Langevin equation of an overdamped bistable 
system. It allows us to study the dynamics of the escape process from the 
stable states in the presence of noise. 

The noise signals used in the various experiments have been different. 
Specifically we use either an analogic noise generator, whose nominal spectral 
density is flat up to 2 x 10^ Hz and whose root mean square voltage level 
Vrms is ranging from 0.05 to 7 F and a digital pseudorandom noise source 
with Gaussian probability density function, correlation time as short as 20 
nsec and root mean square voltage level Vrms ranging from 0.003 to 2.4 V. 
We are at the moment not able to use controllable noise source with a shorter 
correlation time. For this reason when the experiments require a rather fast 
time scale of our system (for example: (i) to investigate a broad range of 
frequency of the modulating signal in stochastic resonance experiments or 
(ii) to detect the response of the system to a second source of randomness 
for a broad range of correlation rate in resonant activation experiments) the 
experiments are unavoidably performed in a colored noise regime. 



3 Stochastic Resonance 

In order to observe the phenomenon of stochastic resonance, we may tune our 
system either in a physical state associated with an asymmetric generalized 
potential or in a physical state ensuring that the noise activated escape from 
states A and C occurs with the same average time, namely in an approxi- 
mately symmetric generalized potential. In our experiments, the series of the 
resistor R with the germanium tunnel diode (1IV3149A) is driven by a sum 
of a sinusoidal signal of amplitude V), and frequency /«, and a noise signal. 
A network of general purpose low-noise operational amplifier is used to sum 
the two signals. The voltage across the diode is digitally recorded and/or 
analyzed with a spectrum analyzer. 

In all cases, the sinusoidal signal is insufficient to cause a deterministic 
transition between the two wells but has the effect of tilting the potential, 
first to the “right” and then to the “left”, one-half cycle later. In our series of 
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measurements, we can vary the amplitude and frequency of the deterministic 
signal and the amplitude of the noise signal. 

By keeping constant the amplitude of the modulating frequency we have 
investigated the SR phenomenon as a function of noise amplitude [14], the 
correlation time of noise and the frequency of the modulating signal [14, 15]. 




Fig. 1. Time evolution of the output of the bistable system Vd{t) for different noise 
conditions. The top curve refers to the case of random jumps between the two 
stable states in the presence of a low value of the noise (V7ms) allowing sporadic 
jumps between the two stable states. Middle curve presents the typical pattern of 
stochastic resonance (observed for Km« = 2 V*m 3 ) ■ The bottom curve presents the 
time evolution of Vd (t) for an high value of the noise VrTTia = 10 Km,. 



To provide an example of the typical time series detected in our studies, in 
Fig. 1 we show the time evolutions of the diode output measured for three root 
mean square values of the noise voltage, K-ms = Kms; 2 K*ms 10 
from top to bottom respectively. Here the minimum noise amplitude 

necessary to observe jumps in the investigated system. In the experiment 
shown in Fig. 1 = 0.67 V, the amplitude of the periodic signal is kept 

fixed to K* = 1 V and the frequency is set to 1.0 kHz. When the noise 
voltage is at the lowest value (Kms = V*ms^ top curve of Fig. 1), we observe 
the output of the diode jumping occasionally from one state to another. The 
average residence time in the two state is pretty different because in the shown 
experiment the associated generalized potential is asymmetric. In addition 
to the jumps, one can note that the output signal is also deterministically 
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modulated by the driving signal. As the level of the noise increases, the diode 
begins to switch between the two stable states in an almost periodic way 
{Vrms = 2 middle curve of Fig. 1). At this noise level the signal to 

noise ratio assume a maximal value. When the noise introduced is relatively 
intense with respect to the height of the potential barrier, the transition 
between the two stable states occurs randomly over the whole range of times 
during the cycle of driving signal and the SR phenomenon subsides (e.g., 
Vrms = 10 bottom curve of Fig. 1). 

Our experimental set-up is rather versatile for the SR investigation and 
allows studies of the SR phenomenon in a wide range of the control parame- 
ters. We have investigated the phenomenon in a wide range of the frequency 
of the modulation signal ranging from 100 Hz to 10 kHz. The phenomenon 
has also been investigated for different values of the noise correlation time. 
Other experimental studies of the stochastic resonance phenomenon about 
the role of the amplitude value of the modulating signal and extending the 
range of the frequency of the modulating signal are ongoing [16]. 



4 Resonant Activation 

Noise is unavoidably present in any kind of physical system. The effects of its 
presence in nonlinear metastable or bistable systems cannot be modeled in 
a simple way. This implies that rather unexpected phenomena are predicted 
and experimentally observed in the dynamics of nonlinear systems in the 
presence of noise. One of these phenomena is resonant activation. This is a 
phenomenon in which the average escape time of a Brownian particle moving 
in a fluctuating metastable potential has a minimum for a finite value of the 
correlation rate of the randomly fluctuating barrier [5j. 

Here we present an experimental study of a metastable physical system, 
which is randomly switching between two states in the presence of a “thermal” 
noise. A similar system is the simplest physical system where resonant activa- 
tion may occur. Our specific experimental investigation concerns a metastable 
state obtained by using an electronic network composed by a tunnel diode 
in series with a resistor [17]. The instantaneous equation of motion of such a 
system is Eq. (3). As discussed above, the associated potential is a bistable 
one. We choose the control parameters of our electronic network [Vb, R, and 
f{vd)) in a way that ensures that one of the two wells is much deeper than 
the other. By setting such strong asymmetry between the two wells we es- 
sentially deal with a metastable state (the probability that the system once 
escaped goes back into the metastable state during the experimental time 
is negligible). By using a digital electronic switch we vary the value of the 
series resistance of our metastable system between the two values R+ and 
R-. When the system switches from to two effects take place. One 
concerns the variation of the height of the barrier of the metastable state 
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whereas the other consists in a change of the value of the “time constant” 
experienced by the system (the RC term of Eq. 3). 

The analogic external noise Vn{t) is obtained by using a digital pseudoran- 
dom generator. The noise voltage is a stochastic Gaussian noise synthesized 
by a commercial source (the noise generator DS345 of Stanford Instruments) 
characterized by a correlation time shorter than 100 nsec. In addition to the 
Gaussian noise source, a dichotomous noise source is also present. This di- 
chotomous noise source is obtained by using the commercial chip MM5437 
of National semiconductor. An external clock of frequency fc drives the di- 
chotomous noise source and allows us to control the noise correlation rate 7 
over a wide range. In our experiments 7 is varied in the range from 18 Hz to 
316228 Hz. This is a frequency interval consisting of more than 4 decades. To 
allow an investigation over a so large range of frequency we need to choose 
a comparably short ’’time constant” of the system. This force us to perform 
our investigation in a regime of colored noise. 

Under computer control, we measure, for each value of the correlation time 
of the binary noise, 5 x 10^ escape times from the potential well measured 
in different statistical realizations of the process. We define the escape time 
T as the time interval measured between the setting of the system in the 
minimum of the well {t = 0) and the crossing of Vd of a voltage threshold. 
The selected voltage threshold ensures that the system is quite far from the 
starting well (we choose Vd = 0.4 U). The exact value of the threshold is not 
a determinant parameter because the escape from the well is rather fast (less 
than 60 nanoseconds). Prom the set of measured escape times r, we determine 
the average value < r > and the probability density function of the residence 
time P{t). The shape of P(r) is well approximated by an exponential function 
for small values of the correlation time of the binary noise and in the region 
of resonant activation whereas for long correlation times we detect a non- 
exponential shape [17]. These findings are in agreement with the results of 
a numerical simulation of resonant activation in a metastable model system 
[18]. 

In Fig. 2 we show an example of the results obtained. The average es- 
cape time from the metastable fluctuating state initially decreases, reaches a 
minimum value and then again increases as a function of 7. The minimum 
is observed for a finite value of 7. This behavior is the typical behavior of 
resonant activation [5, 19-26]. The minimum average escape time is observed 
at 7 « 1.3 X 10“* Hz. This is a value higher than both Kramers’s rates of 
the two configurations when they are not fluctuating, namely /i_|_ = 1/ < 
r+ >= 121.9 Hz and = 1/ < r_ >= 1234. Hz. The minimum average 
escape time is < r >= 0.00126 sec, a value which is approximately 10% 
less than the one expected from resonant activation theories in the kinetic 
approximation [21,25], namely < r >= ((//+ -1- ^_)/2)“^ = 0.00147 sec. 
The value of < r > measured for the smallest value of the flipping rate 
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Fig. 2. Natural logarithm of the average escape time from the metastable state as 
a function of the inverse of the correlation time of the binary noise 7. The average 
escape time has a minimum for a finite value of 7, a feature characterizing resonant 
activation in a metastable state. 



7 = 23.4 Hz is 0.00422 sec. This value is close to the expected one [5,21,25] 
of < r >= (< T_ > + < r+ >)/2 = 0.00453 sec. 

Resonant activation is experimentally observed in our system in spite of 
the fact that the Gaussian noise mimicking the presence of temperature is 
colored instead of being “white” . In our opinion, our result shows that the 
resonant aetivation phenomenon is pretty robust and may be observed in a 
variety of physical systems. 



5 Noise— Enhanced Stability 

Another counter-intuitive noise induced phenomenon is noise enhanced sta- 
bility. Noise enhanced stability was first theoretically proposed in Ref. [6]. In 
this phenomenon, a metastable system is strongly modulated by a determin- 
istic signal in the presence of a finite amount of noise. Two major regimes 
are present in the absence of noise: 

(i) An overall-stable regime. A regime in which the voltage (or the particle 
position in the mechanical counterpart) remains confined between two 
values and it is located inside the well of the generalized associated po- 
tential; 
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(ii) An overall-unstable regime. A regime in which the voltage or the parti- 
cle (characterized at time t = 0 by a given initial condition) leaves the 
potential well at a given time. 



In the presence of noise the overall-stable regime becomes metastable, 
the stability of the system is higher for lower values of the noise. On the 
other hand, in the overall-unstable regime the stability of the system is a 
nonmonotonic function of the noise amplitude. Specifically, it might exist a 
region in which a finite amount of noise increases the stability of the otherwise 
deterministically unstable system. The extension of this region is controlled 
by the values of the parameters of the problem. 

In Ref. [7], it has been shown that the phenomenon of NES is experimen- 
tally observable in a physical system. The experimental results obtained in a 
physical system based on a tunnel diode are summarized in Fig. 3 where we 
show the average residence time measured as a function of the noise ampli- 
tude Vrms for two scts of parameters characterizing the physical system. 

In this kind of study, we again investigate a physical system characterized 
by a strongly asymmetric generalized bistable potential. For each independent 
realization the system always starts in the minimum of the well characterized 
by the smaller barrier at t = 0. For the noise intensities used in our experi- 
ments the probability that the system goes back to the starting well after the 
escape is totally negligible due to the difference of barrier height of the two 
well. As in other studies, we define the escape time as the time interval mea- 
sured between t = 0 and the time at which the tunnel diode voltage crosses 
a threshold value {vd = 0.4 V). The specific value of the threshold does not 
affect the determination of the escape time because the escape from the well 
is very fast. After the escape the system reaches and stays in the minimum 
of the second well until the control electronic network quickly moves it into 
the starting well for a new realization. Hence for all practical purposes our 
system behaves as a metastable state. For more experimental details see [7]. 

The upper curve of Fig. 3 refers to a deterministically overall-stable regime 
while the lower curve refers to a deterministically overall-unstable regime. 
The dashed area is the area where noise enhanced stability is observed. It is 
worth pointing out that in this specific case the region of NES covers more 
than 2 order of magnitude of noise amplitude. In the figure is also shown the 
scaling behavior, theoretically predicted in Ref. [27] and investigated in Ref. 
[28], for a system in its marginal state (i.e. for a system with a potential well 
negligible small). 

The scaling law for the marginal state clearly separates the overall-stable 
from the overall-unstable regime. In Ref. [7] we quantify the degree of overall 
-stability or -instability by introducing the parameter S defined as 
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Fig. 3. Experimental results of the average escape time from a metastable system 
(obtained with a tunnel diode) as a function of the noise amplitude . The parameter 
5 (see Eq. (4)) is <5 = —0.0039 (o) for the overall-stable regime and 6 = -f0.0039 
(A) for the overall-unstable regime. The shaded area shows the region where NES 
is observed. The dot-dashed line is the scaling behavior theoretically predicted for 
a marginal state. 



where A is the amplitude of the modulating signal and Asm is the amplitude 
at which the system crosses deterministically from the overall-stable to the 
overall-unstable regime. 

The probability distribution of the average escape time is a multi-peaked 
distribution with an exponentially decaying envelop in the overall-stable 
regime. The same shape is also observed in the overall-unstable regime. Ex- 
perimental results also show that the square root of the variance of the aver- 
age escape time is of the order of the average escape time. This observation 
is in agreement with the hypothesis that the probability density function is 
well described by a distribution of a series of equidistant sharp peaks with 
an exponential decaying envelope. 

The shape of the peaks of the probability distribution is close to a Gaus- 
sian. The standard deviation of each Gaussian is roughly independent of the 
order n of the peak. This is in agreement with experimental observations of 
stochastic resonance obtained in the strong modulation regime [29]. 

Most of these experimental findings together with a few differences are 
observed in a numerical simulation of a model system [30]. The observed 
discrepancy concerns the exact shape of each peak of the multipeaked distri- 
bution of the average escape time. In fact in the numerical simulation, the 
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agreement between experimental data and a multipeaked Gaussian exponen- 
tially decaying probability distribution is good but a slight asymmetry in the 
experimental peaks is clearly detected especially in the tails of each peak. 

6 Conclusion 

Examples of counterintuitive phenomena observed in noisy bistable and meta- 
stable systems are stochastic resonance [1], resonant activation [5] and noise 
enhanced stability [6]. The comprehension of noise role in the dynamics of 
nonlinear systems plays a key aspect in the efforts devoted to understand and 
model so-called complex systems. Moreover the optimal knowledge of noise 
characteristics is playing an increasing crucial role in the development of new 
families of integrated circuits working at microwave frequencies and used 
in telecommunication systems. For a better comprehension of noise induced 
phenomena, it is certainly useful to perform studies in simple physical systems 
which are low-cost and easily and precisely controllable. A bistable electronic 
network based on a tunnel diode is certainly suitable for detailed experimental 
investigations of noise induced phenomena. 

This research is supported by INFM, ASI (grant 98-83) and MURST. 
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Abstract. We studied the process of proton transfer from oxygen of serine 195 
to nitrogen of the imidazole ring of histidine 57 that takes place in the active site 
of the enzyme a-chymotrypsin (CT). We studied the dynamics of the proton in a 
non-stationary potential of the active site of CT with regard to the fluctuations 
determined by the oscillations of the clusters. In addition to tunneling in the non- 
stationary potential we observed an incoherent dynamic irreversible process of the 
over-barrier transfer, that is caused by the noise action. The fluctuations of the 
potential field of the active site were described by either white or colored noise. 
Probability and energy parameters were obtained for both cases. We studied the 
influence of the amplitude and frequency of the colored noise and the asymmetry 
of the potential wells of the non-stationary two-minimum potential on the proton 
dynamics. It was demonstrated that over-barrier proton transfer plays the most 
important role. 



1 Introduction 

Conformational changes of the enzyme molecule are related with transitions 
of the multi-stable system from one equilibrium state into another under 
the action of, for example, thermal fluctuations or some other external fac- 
tors (light quantum, chemical reaction, etc.). Proteins consist of thousands of 
atoms and, therefore, the calculation of this process with the use of molecu- 
lar dynamics is quite difficult. It is assumed that protein molecules consist of 
relatively rigid clusters, that is why such transitions between the multi-stable 
states and the fluctuation motions can be described by the methods of classi- 
cal cluster dynamics [see, e.g., Shidlovskaya, Schimansky-Geier, Romanovsky 
2000, Netrebko et al 1994, Romanovsky 1997, Shaitan 1994]. The molecule 
as a whole can be considered with the use of classical dynamics, whereas 
the active site must be considered as a quantum system. Below we consider 
a particular model of the enzyme. According to the X-ray data [Birktof, 
Blowl972; Havsteenl989, 1991] the CT-molecule consists of two subglobules 
each of which consists of six more or less rigid clusters. The structure of the 
molecule is stabilized by H-bonds. One of the key stages of the catalytic act 
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is related with proton transfer in the H-bond between serine 195 and his- 
tidine 57 [Fershtl977]. Note that such a proton transfer is typical for other 
hydrolytic enzymes (e.g., acetylcholinesterase) [Quinn 1987, Romanovsky et 
al.l999]. Similar problems are met in the case of consideration of the prob- 
lems related with proton transfers in a chain of H-bonds [Davydov 1985, 
Nylund et al.l993; Manevich et al. 1994]. We study proton transfer in a local 
potential energy profile in a pocket of CT active site (Fig. 1). The profile was 
calculated by semi-empirical method PND for a free active site and the com- 
plex with the ligand. In the latter case the peptide bond of the substrate was 
positioned in the close vicinity of the H- bond of the catalytic group. Proton 
transfer takes place in the potential field of the atoms that belong to different 
clusters. In the absence of the substrate the potential profile is asymmetric 
and the potential barrier is high (about 30 kcal/mole). The substrate binding 
causes a series of local conformational changes in the active site that result 
finally in the symmetrization of the potential profile and lowering of the bar- 
rier [Romanovsky, Khurgin & Chikishev(1988)j. The characteristic time of 
the conformational changes is about 100 ps [Rubin (1987)] which is much 
larger than the period of oscillations of clusters. That is why in our model we 
calculated the proton transfer under adiabatic approximation with regard to 
only thermal fluctuations of the clusters and assuming symmetrization of the 
potential profile. Related problems are discussed in monograph [Chernavsky, 
Chernavskaya 1999]. 

2 Method of Calculation of Proton Dynamics 
in a Stochastic Potential 

The calculated symmetric potential V (r) was approximated by a sum of two 
Morse potentials, 17 (r + ^/2) and U (— r -|- A/2), and the polynomials of even 
orders: 

V^{r) = U{r +^) + U{-r + f ) + ^ - ro)^^ (1) 

n 

where n = 0, 1, 2, 

U{r) = Z?o{exp[-2a(r - tq)] - 2exp[-a(r - tq))]}. 

Here Do is the depth of a single Morse potential and tq is the position of 
its individual minimum as well as the center of the barrier; A determines 
an equilibrium distance between the wells’ minima; coefficients (7„ are calcu- 
lated to fit experimental data on the transition frequencies. All the random 
processes of cluster dynamics lead to fluctuation changes of the distance 
between the N and O atoms in the H-bond. That is why the time depen- 
dence of the stochastic two-minimum non-stationary potential is determined 
by the change of the distance between the minima A{t) = A + ^{t). Here 
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Fig. 1. a) Two-domain structure of Q-chymotrypsin. Shown are the amino acid 
residues serine 195 and histidine 57 of the active site; b) a scheme of the fragment 
of the active site with the H-bond Serl95-His57 in which the proton transfer takes 
place along the coordinate r; c) symmetric one-dimensional potential of the H-bond 
Serl95-His57. 



^(f). = ^(^ 0 , no,t) is the classical noise vibration with the characteristic fre- 
quency J?o and amplitude of the oscillations of the clusters. The latter 
were estimated as [Romanovsky, Tikhomirova & Khurgin(1979)]: 

f2o « 10^^ -MO^^ Hz, ^o«0.1-i-0.2 A (2) 

In this work we consider proton transfer under the action of delta-correlated 
external action and random oscillations of the clusters. We studied the influ- 
ence of the asymmetry of the potential, amplitude of the colored noise and 
the detuning of the central frequency of the colored noise from the resonance 
frequency of the system on the probability of proton localization in one of 
the wells of the potential profile. 

We used a quantum trajectories approach to the proton dynamics bas- 
ing on calculation of the time- dependent wave function governed by the 
Schrodinger equation in the presence of classical noise. The wave function 
is localized initially in one of the wells. The probability of the proton trans- 
fer and the total energy of the proton are determined by the wave function. 
Fluctuation processes related with interactions of the enzyme molecule with 
environment are taken into account by means of introduction of the stochastic 




Proton transfer in a fluctuating potential 341 



potential into the Hamiltonian of the system under study: 

H — Hq + V^, Hq = ^ + Vq, = V4+4(()(r) - Ho- (3) 



Here p,f are the operators of the momentum and coordinate and ^{t) is the 
classical noise. Undisturbed potential Ho = Ho(r) is given by Eq. (1) with no 
shift of the distance A. Noise perturbed operator of the potential energy 
is approximated as 



Hf = 



duio 



di 



«=o 



( 4 ) 



Proton dynamics was calculated with the use of the computer codes based 
on symmetrization of the evolution operator [Kosloff 1988]. For the system 
described by the Hamiltonian H (t) = p^/(2m) + H (r, t) the unitary transfor- 
mation of the wave function for a time step At is represented in the symmetric 
form 



S{At) « exp 



, H(f,t) 

2h 



At 



exp 




exp 



2h 



At 



This representation minimizes the error due to non-commutativity of opera- 
tors p^,V{f,t) and provides the possibility to simply apply the transformation 
to the wave function as a non-operator multiplication, if only each time ijj 
is converted to a proper choice of either r or p- representation. 

We suggest that the initial state wave function 0) is localized either 
in the first or second well and belongs to the tunnel-splitted minimum energy 
state of the unperturbed Hamiltonian Hq: 



V'(uO) = ~[ips{r) ± tpa{r)], (5) 

where V’s.a are the eigen symmetric/antisymmetric eigen functions, Hoips,a = 
Es,a‘4’s,a - If the noise perturbation is neglected, these states evolve exactly like 
the ones of a two-level system so that the other eigen states ipn of Ho are not 
involved into dynamics. A relaxation takes place in the system described by 
the Hamiltonian (3) under the action of perturbation (4). The perturbation 
(4) is classical and the relaxation process is determined by the dephasing 
mechanism discussed in [Burstein 1963]. The characteristic time of relaxation 
of the system is given by [Fine 1972]: 

27T 

r, = (21H)-' = —\V, 2 ?g{ojo - cn). (6) 

Hi 2 is the matrix element of the perturbation; wq is the resonance frequency 
of the system, and w is the noise frequency. The formula (6) is valid under 
the condition of sufficient smoothness of the spectral power density of the 
noise p(w). 
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The white noise is used for simulation of fast non-correlated vibrational 
motions of the valence bonds by which N and 0 atoms are bound to the 
clusters. The random variation of the distance between the minimums 
of the potential in the case of the non-correlated perturbation (white noise) 
was modeled as a discrete time sequence with statistically independent ran- 
dom values, introduced properly to represent the process with the correlation 
function 

= K^{t' - t") = 2nGoS{t' - t"). (7) 

Therefore, ^(f) represents the <5-correlated process with the constant spectral 
density G((ui) = 2 ^q/7T = Gq. As the changes of the length of the H-bond 
due to stretching vibrations of the corresponding atoms are not large, the 
amplitude of the white noise is much smaller than that given by (2): = 0.01 

A. The absolute difference between the energies corresponding to the minimal 
and maximal distances does not exceed ksT = 0.6 kcal/mole. Random cluster 
oscillations caused by the action of the medium on the enzyme molecule are 
simulated by colored noise [Schimansky-Geier, Ziilicke 1990], the amplitude 
and the frequency of which are determined by (2). Transformation L~^ of 
the white noise ^(t) into colored noise x(t) is determined by: 

Lx = X + 2 Sx + ojqX = ^(t). (8) 

This is stochastic Lange vin equation of the second order. The spectral 
power density of the colored noise determined by the equation (8) is given 
by: 

" (a;2 - w2)2 + 452^^2 • ( 9 ) 

The width of the contour g(uj) is F = cj/Q, and the corresponding damping 
is (5 = w/(2Q) and the responding quality factor is Q w 10 [Romanovsky, 
Khurgin & Chikishev 1988]. In our calculations we varied the frequency w 
and Gq. Studying the influence of the colored noise on the dynamics of the 
proton in the stochastic potential we varied the detuning 6 uj = ujQ—uires = 

(n is an integer) of the central frequency of the noise wq from the resonance 
frequency of the system Wres and the amplitude according to (2). 

We analyzed the time evolution of probability of proton localization in one 
of the potential wells. The corresponding dependencies allow one to determine 
the time of the proton transfer. The time dependence of probability in the 
case of white noise action can be approximated by [Lax 1968]: 

P{t) cos(27ri/if) exp • (10) 

The time of the transfer is determined in this case as the time tq of relaxation 
to the stationary state. The relaxation time for the system in the case of 
colored noise action is determined after selection of the local maxima and 
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approximation of this set by a function: 

papp-(t) = l + iexp(|-Aj. (11) 

3 Proton Dynamics in a Non-stationary Potential 

The characteristic times of the proton transfer in the stochastic potential with 
different parameters are summarized in the Table 1. The tunneling frequency 
for the symmetric stationary potential is about 17 ps“^ (the splitting is AE = 
2 • 10“^ kcal/mole). The Fig. 2 shows the relaxation of the probability P{t) 
to the stationary level for the case of the white noise action. Approximation 
parameters (see (10)) for this dependence are: tq = 12 ps and ui = 17 ps~^, 
the latter virtually coincides with the tunneling frequency of the stationary 
potential. The calculation of tq with the use of the formula (6) yields the 
value: =: 13 ps. It is seen from Fig. 2b that the total energy of the 

proton increases, which provides evidence of the proton transition to the 
highest states. 

We calculated the time dependencies of the probabilities for the case of the 
colored noise action and determined the transfer times tq for the amplitude 
0.18 A at the range of (2) and the detunings Au = -5F, — 3F, 0, SF, 5F. 
Here F is the width of the contour of the spectral density of the colored noise 
(9). The calculated relaxation times were compared with those determined 
theoretically according to formula (6) (see Table 1). 

The Fig. 3 shows time dependence of the probability and total energy of 
the proton for the amplitude of the colored noise 0.18 A and the detuning 
Aui = 5F. 

The characteristic time for the probability (Fig. 3a, formula (11)) was 
determined to be Tq = 9 ps. The theoretical value (formula (6)) is Tq*'®®’’ = 11 
ps. It was found out that for the case of the colored noise the relaxation 
time is inversely proportional to the square of the noise amplitude. For the 
amplitude = 0.01 A and the detuning Au = 5F (Fig. 4) the theoretical 
value of the transfer time is Tq'*®®'' = 3447 ps. 

The probability of the proton transfer is maximal for the case of the sym- 
metric potential profile. The asymmetry is much more critical for tunneling 
than for over-barrier transfer. 

We studied the potential: 

V{r) = U(r) + (1 - q)U{-r + Ar) C„(r - ro)", (12) 

n 

where U{r) is given by formula (1) and q is the degree of the asymmetry. We 
performed calculations for two differences of the depths: 

r 2.29-10-2, 9 = 3-10-2; 

\ 1.529 - 10-\ 9 = 3 - 10-A 



AU = 



(13) 
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** noise amplitude 

*** asymmetry coofitient . 



4 * tunneiing period. 

S* theoreticai reiaxation time. 

6* reiaxation time. 

Table 1. Characteristic times of the proton transfer in stochastic potentials with 
different parameters. 



In the first case AU w AE^u=a ^ 10“^ kcal/mole; in the second case AU 3> 
AEau=o (AE — 1.58 • 10~^ kcal/mole (1)). Tunneling is impossible for both 
cases. For the smaller asymmetry and white noise = 0.01 A (see Fig. 5a) 
the transfer time is tq = 19 ps (tq**®®'' = 14). Over-barrier transfer is possible 
for the larger asymmetry as well (Fig. 5). 

4 Discussion 

In the stochastic potential an irreversible process of phase relaxation of the 
probability of proton localization in one of the wells takes place. The energy 
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Fig. 2. Proton dynamics in a stochastic potential under the action of the white 
noise: a) P(t) is the probability of proton localization in one of the potential wells 
(solid line shows the approximation curve) in dependence from the time t(fs); b) 
E(kcal/mole)is the total energy of the proton in dependence from the time t(fs). 



of the proton increases and the proton reaches the levels above the barrier. 
The mechanism of phase relaxation (dephasing) is determined by the in- 
teraction with the highest states that plays the most important role in the 
over-barrier transfer. In our model we do not take into account the rela- 
tionship between the position of the proton and the shape of the potential 
profile. That is why reversible tunneling does not describe proton transfer 
in contrast to irreversible over-barrier transfer. In addition, the probability 
of tunneling is much less than the probability of the over-barrier transfer in 
the asymmetric non-stationary potential. Thus, we assume that irreversible 
incoherent over-barrier transfer resulting from the fluctuation changes of the 
shape of the potential profile determines the mechanism of the proton transfer 
in the active site of the enzyme. Note that the problem of transfers in dif- 
ferent non-stationary two-minimum potentials was addressed in many works 
[Grossmann 1991; Hesse, Schimansky-Geier 1991; Elyutin, Rogovenko 1999]. 
The most important results are reported in [Kagan 1991], where it is demon- 
strated that under certain conditions over-barrier transfer dominates over 
tunneling. 
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Fig. 3. Proton dynamics in a stochastic potential under the action of the colored 
noise with the detuning Aui = 5F of the central frequency wo from the resonance fre- 
quency of the proton transition between the lowest tunnel-splitted states; = 0.18 
A: a) P(t) is the probability of proton localization in one of the wells in dependence 
from the time t(fs); b)E(kcal/mole) total energy of the proton in dependence from 
the time t(fs). 



5 Conclusions 

An irreversible relaxation dynamics of a proton in a two-well potential was 
described with use of stochastic Schrodinger equation. A localization of the 
proton in one of the wells turned to be a random event, which probability 
at the level of 0.5 takes place under the influence of both white and colored 
noise. The energy of the proton in the stochastic potential increases. Thus, 
the over-barrier proton transfer occurs. We calculated the characteristic times 
of the proton transfer in the stochastic potentials with different parameters. 
Under the action of the colored noise the relaxation time is maximal for the 
case when the central frequency of the noise coincides with the resonance 
frequency of the system corresponding to splitting of the first tunneling level. 
In the case of the colored noise the relaxation time is inverse proportional to 
the amplitude of the noise. In the case of the asymmetric potential tunneling 
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Fig. 4. Proton dynamics in a stochastic potential under the action of the colored 
noise with the detuning Auj = 5F of the central frequency wo from the resonance 
frequency of the system; = 0.01 A: a)P(t)is the probability of proton localization 
in one of the wells in dependence from the time t(fs); b)E(kcal/mole)is the total 
energy of the proton in dependence from the time t(fs). 



is impossible. The action of the colored noise makes the over-barrier transfer 
possible for small asymmetries: AU ss AE^u=o ^ 10“^ kcal/mole. Whereas, 
the action of the white noise makes over-barrier treinsfer possible for both 
small AU Ki AE^u=o and large AU 3> AE^u=o asymmetries. 

In the future studies of the proton transfer we plan to take into account 
the relationship between the proton motion and the shape of the potential 
profile. We also plan to construct the potential profiles by means of ab initio 
calculations and to compare the new profiles with those obtained by means of 
the semi-empirical methods. We also plan to consider dynamics of the proton 
in 2D and 3D potential profiles. It is worthwhile to consider also the follow- 
ing problems. 1) It was demonstrated earlier [Shidlovskaya et al., 2000] that 
classical Fermi-resonance can take place in 2D potential wells. Note that this 
problem was posed for the first time by Fermi who calculated the splitting of 
levels in a system with 2:1 ratio of transition frequencies [Fermi, 1931]. That 
is why we plan to study the problems of quantum Fermi resonance in 2D pro- 
files. 2) The phenomena similar to stochastic resonance [Anishchenko, et al.. 
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Fig. 5. P(t)is the time evolution of the probability of proton localization in of 
the potential wells of the asymmetric profile (AU — 2.29 ■ 10“^ {q — 3 ■ 10“^), 
AU ^ AEau=o w 10“^ kcal/mole under the action of a) white noise (solid line 
shows approximation curve) and b) colored noise with the aimplitude = 0.18 A 
and the frequency w = 1.05 • 10**. 

1999], [Anishchenko, Vadivasova, Astakhov, 1999], [Reimann, Hanggi, 1997] 
must be studied in the case of quantum transitions between two potential 
wells. 
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Abstract. A gentle introduction to the simulation of stochastic differential equa- 
tions is presented, with particular attention to the simulation of rare fluctuations, a 
topic of interest in the light of recent theoretical work on optimal paths. The “best 
algorithm” and some problems connected to the treatment of the boundaries will 
be discussed. 



1 Introduction 

A common denominator of the papers contained in this book is the presence 
of stochastic processes, introduced to model a variety of different physical 
situations. Unfortunately, the most common situation is that the stochas- 
tic model cannot be exactly solved; then, one typically turns to simulations, 
analogue or digital, of the system of interest. A very complete review of ana- 
logue techniques has recently appeared, and the interested reader is referred 
to it for further details [1]. We concentrate here on digital simulations, with 
particular emphasis on simulations of rare fluctuations. Rare fluctuations are 
fluctuations which bring the stochastic system very far from the phase space 
which the system explores most of the time. It is possible to relate the hap- 
pening of a rare fluctuation to some building up of an activation energy (one 
can think of the energy necessary to overcome a potential barrier, like in a 
chemical reaction). The nature of rare fluctuations is such that we should 
have algorithms which correctly explore the tails of the distribution func- 
tions; we should be able to stop in a correct way our simulation when the 
rare fluctuation hits a prescribed boundary in phase space; we should opti- 
mise, if possible, our algorithms to situations when the system lacks detailed 
balance; and, finally, we should have pseudo random number generators fast 
and very reliable, able to provide us with very long random sequences. We 
will address all these problems in this paper. For further comments and ref- 
erences, the interested reader can consult, among others, [2-5]. 

2 The Basic Algorithm 

A stochastic differential equation has the generic form 

Xi = fi{x) -b 9 i{x)i{t), = 0, {^{t)i{s)) = S{t - s), (1) 
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where we assume that the stochastic process ^ is Gaussian and that only one 
stochastic forcing is present. In the following, we call h the integration time 
step, and we use Stratonovich calculus [4]. A simple minded approach to solve 
Eq. 1 is to formally integrate it, then to use a Taylor expansion around the 
point t = 0, to find recursively the various contributions [6]. Restricting the 
discussion to a one dimensional case, the equation has the form 

X = f{x) + g{x)C{t) (2) 



A formal integration yields 

x{h) - a:(0) = f if{x{t)) + g{x{t)X{t)) 
Jo 



dt 



( 3 ) 



Let us define 



fo = f(x(0)) go = 



dx{t) 



x=x{Q) 



and so on. By Taylor expansion it is meant that the functions are expanded 

as ft = fo + {x{t) — x{0))fo + The simple minded lowest order in h seems 

to be ^ ^ 

x{h) - x(0) = / (/o + go^{t)) dt = hfo + go [ (4) 

Jo Jo 

We will see that this is not the correct lowest order in h. For the moment, 
note that on the r.h.s. there is a so called “stochastic integral” 



Zi(h)= [\{t)dt (5) 

Jo 

which is the integral over the time range (0, h) of the stochastic process ^(t). 
This integral is a stochastic variable, and the integration amounts at adding 
up some gaussian variables: as such, Zi{h) is itself a Gaussian variable, or, 
in other words, its probability distribution is a Gaussian distribution. This 
implies that the probability distribution of Zi{h) is determined once the 
average and the standard deviation of the distribution are known. A simple 
minded numerical integrator would then be, at each time step: generate a 
random gaussian variable, with appropriate average and standard deviation 
(to “simulate” the stochastic integral); substitute the stochastic integral on 
the r.h.s. of Eq. 4 with this random variable; integrate the equation using any 
standard integrator valid for deterministic differential equations. How can 
we work out the statistical properties of Z\{h)l As we mentioned, we only 
need its average and its standard deviation. Using (...) to indicate statistical 
averages, 

(Zi) = f (as))ds = 0 (6) 

Jo 

{Zf{h)) = f [ {^(s)^{t))dsdt = f f S{t-s)dsdt= ( ds = h. (7) 
Jo Jo Jo Jo Jo 
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If we introduce a stochastic gaussian variable with average zero and standard 
deviation one, Yi, it follows that we can write the following representation 
for Zi{h) 

Zi{h) = s/hYi 

meaning that, using this definition, Zi(h) has the correct statistical proper- 
ties. We can also rewrite Eq. 4 as 

x{h) - x{0) = hfo -I- Zi{h)go = hfo + \/hgoYi. (8) 

A problem is apparent; on the r.h.s., the first term is order of h, but the 
second one is order of y/h\ in principle, we should insert the x increment 
from Eq. 4 in Eq. 3, take one more term in the Taylor expansion, and check 
the order of the contribution we get. It turns out that if we do that, the 
correct algorithm to first order in h is 

x{h) - a;(0) = 50-^1 {h) + foh+ ^g'ogoZi {hf (9) 

The higher order terms are obtained by recursion, inserting the lower order 
terms in Eq. 3 and collecting the different contributions. Before we write the 
algorithm at order of h? (which is the highest order we can get recursively), 
let us introduce other stochastic integrals which are relevant. In the following, 
El is the same stochastic variable used for Z\ [h) , and E 2 and E 3 are two more 
gaussian stochastic variables, with average zero and standard deviation one, 
independent of each other. We need 

Z-i{h) = J Z^{s)ds Si — |ei^ ^ 2} 

For additive noise {g{x) = V2D), the algorithm reads 

x{h) = x{0) + V^Ziih) + foh+VWZ 2 {h)fl, + DZsih)/^ + y/'/o (10) 

We will call this the “Full algorithm”. In the n dimensional case, for one 
external stochastic forcing which is additive, i.e. for a system described by 

Xi = fi{x) + gi^{t) 

we find (defining here fij = dfi/dxj evaluated in Xi{t = 0) etc., and assuming 
a sum over repeated indeces) 

Xi{h) = a;j( 0 ) -t- giZi{h) fih + Z2{h)fi^kg). + 

'^fi,jk9i9kZz{h) -f — h fijfj- 



( 11 ) 
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Expressions valid for the more general case can be found in [2] . Other integra- 
tion schemes which can be found in the literature are (see quoted references): 
Euler scheme: Eq. 10, keeping only the first three terms on the r.h.s.. 
“Exact propagator”: solve exactly x = f{x) and then add Z\{h) to take 
into account the noise. 

Heun scheme: Use the following integrator: 

xi = a:(0) -I- V2DZi{h) -I- foh 

x{h) = x(0) -b VWZ.ih) + ^ (/o + fixi)) 

Some authors have developed Runge-Kutta schemes (see [4]). We will see, 
however, that the particular nature of a SDE is such that higher order schemes 
may not lead to substantial improvements to the integration. 



3 Which Is the “Best” Algorithm? 

The problem of the “best algorithm” for a SDE has two aspects: deterministic 
accuracy and stochastic behaviour. 



3.1 Deterministic Accuracy 

One can disregard the stochastic component, and study only the deterministic 
integration scheme, using standard techniques. This gives some indications 
of the “deterministic accuracy” of the scheme considered. In this case, the 
usual machinery (used to work out accuracy, stability etc.) applies. The error 
associated with a given integration scheme is easily evaluated; we find the 
following: 

Euler scheme: accurate up to 0{h). 

Exact propagator: no numerical error associated with this algorithm (by 
definition) . 

Heun scheme: accurate up to 0{h^). 

Full algorithm: accurate up to 0{h?). 



3.2 Stochastic Behaviour 

In this case, one can check the Taylor expansion to judge the short times 
dynamics. It is clear then that the best algorithm in this time range is the 
“Full algorithm”, given that it was derived as a Taylor expansion of the 
stochastic equations. The large times behaviour can be studied, on the other 
hand, deriving the equilibrium properties from the propagator used in the 
numerical scheme (there are other possibilities: for instance, one can consider 
which scheme is the closest to the bona fide trajectory under some measure). 
We have in mind the problem of rare large fluctuations, so, as a rule of 
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thumb, we should use integrators which reproduce as closely as possible the 
large time dynamics, i.e. same equilibrium quantities. Focusing on the large 
times dynamics, the idea is to start from a generic form of the integrator, 
x{t) = x{0) + F{x,t), and, for instance, find the equilibrium distribution it 
generates; then, compare it to the real one. It follows, writing the propagator, 
that [7] 

OO ^ n 

p(x,t + h)- p{x, <) = E E ^ 

71^— X Xi 

where P{x,t) is the probability distribution generated in the simulations, 
starting from an initial P{x,Q) and 

Ki„.n = i-ir-AFl...Fn)noise- 

n\ 

At equilibrium, the difference on the l.h.s. in Eq. 12 is zero, and the r.h.s. of 
Eq. 12 becomes an implicit equations for P{x,oo)). In general, for systems 
in detailed balance, 

00 

P{x^ ^ 6Xp ^ ^ h Sjij D 

n=l 

where all would be zero if the algorithm were exact. Focusing on the 
system 

X = -V'{x) + Vw^{t) 
which has the exact equilibrium distribution 

P{x,oo)true - N exp {-V {x) / D} 

and the actual equilibrium distribution (using the different numerical inte- 
gration schemes) 

P{x,oo)sim = iv' exp {(- 1 ^( 0 ;) + hS{h,x)) ID). 

Carrying out the necessary algebra, it is straightforward to find the function 

S{x) 

Euler scheme: S{h, x) = (V')^ /4 — DV” 

Exact propagator: S{h,x) = {V')^ /2 — DV" 

Heun scheme: S{h,x) = 0{h) 

Full algorithm: S[h,x) = 0{h) 

It is clear that the “Full algorithm” and the Heun scheme are the algorithms 
which most faithfully reproduce the equilibrium distribution. It is also inter- 
esting to note that the “Exact propagator” does not do better than the Euler 
scheme: this implies that to derive higher order algorithms it is necessary to 
deal with the higher order terms coming both from the deterministic and 
the stochastic part of the SDE. But, as we saw in the derivation of the “Full 
algorithm”, at order hA we start to have non gaussian stochastic variables 
{ZAh))^ so higher order schemes may not be well founded. 
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4 The ^/h Problem and Boundaries 

Regardless of the integration scheme used to carry out the integration, there is 
an intrinsic problem with a SDE, due to the discreteness of the integration and 
to the sampling; this is a problem present even with an ideal integrator [8, 9]. 
Fig. 1 shows that a stochastic trajectory appears very different over different 
time scales (i.e., h’s). The problem is most acute when we need to stop the 
integration because a boundary is reached (see the dashed line in Fig. 1), 
like, for instance, in a Mean First Passage Time (MFPT) evaluation: the 
“decimated” trajectory (a trajectory obtained integrating with a larger h) 
simply misses the transition. The cure is simple: we need to evaluate the 
probability that the trajectory hit the boundary and came back, within an 
integration time step, and thus stop the simulations. 




Fig. 1. Comparison between trajectories done with different time steps 



Following [8], for a system described by the SDE 

x = F{x) + vwm, m)=o, = s{t - s) (is) 

the probability that the stochastic trajectory, which is at xq at time t = 0 
and at x^ a.t t = h, hit a boundary Xj> at an intermediate time is given by 



P(hit) = exp 
1 



n 



2D (( 



,2hF! 



1) 



Xh-Xb + (xo - Xb)e^^<> - ^ 



+ 



4Dh 



Xi - [ xq h 



Fo + Fh 



)y 



(14) 



where Fb = F{xb) etc.. At each integration time step Eq. 14 is evaluated, and 
a uniformly distributed random variable is generated in the range (0,1). If 
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the random variable is smaller that Eq 14, it is assumed that the trajectory 
hit the boundary and came back, and the appropriate action for reaching the 
boundary should be taken. 



4.1 Free Diffusion with Absorbing Boundaries 

As a test system we take a bunch of particles injected at the a; = 0, which 
can freely move in one dimension, until they reach the boundaries, located 
at ±L, where they are absorbed [9]. The ruling SDE is 




Fig. 2. MFPT for a particle freely diffusing to a boundary 



x = ^m. (ew) = o. mm = 5{t-s). (i5) 

For h = 0, the MFPT to the boundary is t( 0) = whereas, for a finite h, 
it becomes [9] 

r(h)/r(0) = 1 + y/32/97rV'hAR^- (16) 

Figure 2 shows that indeed the MFPT’s simulated without correction follow 
Eq. 16. As soon as the correction for the finiteness of the integration time 
step is introduced, the agreement between simulations and h = 0 theoretical 
MFPT becomes excellent (lower circles). Let us stress that the integration 
of this dynamical system is exact, due to the structure of Eq. 15, so the 
discrepancy observed for finite integration time steps is due to the sampling. 
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4.2 MFPT in a Bistable System 

Given that the contribution to the MFPT which goes like v7i is due to the 
finiteness in the sampling of the stochastic trajectory, we expect that a similar 
contribution will show up in any MFPT calculation. We plot in Fig. 3 the 
MFPT to escape from a; = — ltox = 0in the system 

X = X - (CW)=0, m^{s))=5{t-s). (17) 

Theoretically, the MFPT in the limit of h 0 should be 

MFPT(h = 0) = ^exp(^^) (18) 

Prom the figure, it is clear that the MFPT’s computed without any correc- 




h/D 



1/2 



Fig. 3. MFPT in the system of Eq. 17 



tion show a square root dependence on the integration time step (best fit). 
However, when the additional stochastic process to simulate the — >• 0 limit 
is introduced, the numerical points show no dependence on the integration 
time step. It is important to appreciate that from the structure of Eq. 18 one 
could believe that, as D becomes smaller, the correction to the MFPT due 
to the finiteness of h should become negligible compared to the MFPT itself. 
Fig. 3 shows that the opposite is actually true: MFPT’s computed for differ- 
ent h's and £)’s scale on the same curve, when plotted against h/^/D: this 
means that if h is kept constant, the MFPT’s simulated without corrections 
differ, proportionally, more and more from the theoretical ones, as D is made 
smaller. For more examples, see [8]. The SDE in Eq. 17 was integrated using 
the Heun algorithm. The statistical error associated with the finite number 
of trajectories is order of the symbol dimensions. 
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5 Non-white Noise 



So far we have considered stochastic differential equations driven by white 
noise. Noise in real systems, however, is very often far from white. An in- 
teresting class of noise correlations is noise which can be written in terms of 
linearly filtered white noise. The simplest one of these noises is the exponen- 
tially correlated gaussian noise 

{T]it)) = 0, {v(t)v{s)) = ^ exp (19) 



or, in term of its spectral density. 






D 

7T (1 -b 



( 20 ) 



The variable r]{t) can be written in terms of a filtered white noise as fol- 
lows [10] 

ri = --v + ^m, m) = o, mm = s{t-s) ( 21 ) 

T r 

Suppose we have a dynamical system driven by additive exponentially corre- 
lated gaussian noise (^(f) will be the usual white gaussian noise with standard 
deviation one) 



X = f{x) + y 

y = ( 22 ) 

T T 



We could use Eq. 11 (or any other algorithm) to integrate Eq. 22. However, 
if tr is the shortest time scale of the dynamical system in Eq. 22, the inte- 
gration time step h should be chosen so that it is much smaller than both tr 
and r. Now, in cases when r is much smaller than tr, it is clear that, making 
h T, we would be using all the computing power to integrate the equa- 
tion describing the exponentially correlated noise, rather than the dynamical 
system itself. 

We recall that Zi (Eq. 5) was obtained adding up some gaussian stochas- 
tic processes: now, the structure of Eq. 22 is such that y is itself a linear 
combination of stochastic random gaussian processes (^(t)), via a filter with 
time scale r. So, it should be possible to use the “Full algorithm” or the Heun 
algorithm, but with a somehow modified Zi{h). This idea has been exploited 
in [11]. Eq. 22 can be immediately integrated, to yield (exactly) 



y{t) = e ' j/(0) + 



/■* ^ 



/ 



-as) 



ds. 



r 



(23) 
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Let us now define some quantities which will be needed further down, namely 

/■'* 

wq= j e I- ^(s) ds 
Jo 

Wi = I I e~ ^(s) ds dt 
Jo Jo 

h 

a=—. 

T 

Clearly, icq, and wi are gaussian variables (they are linear combinations of 
gaussian variables), with zero average and unknown correlations. Working 
out the algebra [11], which parallels the algebra carried out to derive Zi, the 
result one obtains is summarised in Table 1. From the table, if the correlation 











1(1 -e-“) 


i(l-2e-“+e-"“) 






i (2a - 3 - e-2“ + 4e-“) 



Table 1. Correlations for the stochastic variables in the exponentially correlated 
algorithm 



of Wo with Wo is needed, taking the quantity where the row and the column 
labelled wo cross, one can write 



Wo Wo 



7 - 1/2 7 - 1/2 



1 / 2 / 9 



-2a 



which yields 
and so on. We can now write 






y(h) = 1/(0) + ^^^^wo 



Zi{h)= [ y{s)ds~T{l-e “)y(0) + 
Jo 






"^1 



(24) 



and, if Yq and Yi are two independent gaussian variable with zero average 
and standard deviation one, we can finally write 



Wo 









{wiWoY 



k^i. 
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In principle, we need the expressions for Z 2 {h) and Zz{h). Z 2 {h) was derived 
in [11]: however, it turns out that for the exponentially correlated noise case 
the Heun algorithm is faster than the “Full algorithm”, and have a compa- 
rable precision. So, it is suggested to use the Heun algorithm, integrating 
Eqs. 24 to get the Zi{h) needed at each integration time step. Other noise 
spectral densities were considered in [12,13]. For general algorithms and fur- 
ther comments, see also [4, 14, 15]. 

6 Random Number Generators 

It should be born in mind in the integration of a SDE that a good pseudo 
random number generator is more important than an efficient integration 
algorithm. So, particular care must be taken when implementing the code, 
and the literature should be searched for good generators. There are classical 
algorithms, like the Box-Muller algorithm [16], to obtain gaussian random 
variables from uniformly distributed generators; an interesting rejection al- 
gorithm (which is faster than the Box-Muller) is the Ziggurath algorithm [17]. 
Algorithms based on adding a number of uniformly distributed random num- 
bers to obtain a gaussian random number via the central limit theorem should 
be avoided: they are slower than the Box-Muller, and the generated distribu- 
tion of random numbers shows a clear cutoff in the tails. There are a number 
of algorithms to generate a uniformly distributed pseudo random number. 
The state of art seems to be algorithms based on the so called subtract and 
carry [18, 19] or add and carry [20] algorithms: given their characteristics, 
these algorithms are particularly well suited in the simulation of rare fluctu- 
ations. 

7 Conclusions 

We have shown that it is possible to have integrators for SDE which are 
able to reproduce the equilibrium properties of a dynamical system to a high 
accuracy in the integration time step: such integrators are ideal to study 
long times dynamics of phenomena like a large rare fluctuation. We have 
shown that it is possible to simulate properties of a zero integration time 
step process, which implies that we are able to determine with high accuracy 
when a stochastic trajectory reaches a given threshold. Dedicated algorithms 
can be derived in case of noise which is filtered through a n poles Alter, 
speeding up the simulation for these special cases. Finally, some indications 
as to pseudo random number generators suitable for the case at hand have 
been given. 
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Abstract. We review some recent results on large infrequent fluctuations in which 
a system moves far away from a metastable state or mcikes a transition between 
metastable states. Although fluctuations happen at random, the motion in a large 
fluctuation is essentially deterministic. This makes it possible to change fluctuation 
probabilities exponentially strongly by comparatively weak fields, paving the way 
for selective control of escape rates. To investigate large fluctuations experimen- 
tally, we trap a dielectric Brownian pcirticle in a double-well potential created by 
two independent optical beams. By analyzing thermal fluctuations, we can fully 
map the three-dimensional potential. This has allowed us to put Kramers’ theory 
of thermally activated transitions to a quantitative experimental test. A suitable 
periodic modulation of the optical intensity breaks the spatio-temporal symmetry 
of an otherwise spatially symmetric system. This has allowed us to localize a particle 
in one of the symmetric wells. 



1 Introduction 

Large fluctuations, although infrequent, are responsible for big qualitative 
changes in various types of systems and play a crucial role in many phenom- 
ena. A well-known example of large fluctuations is thermally activated escape. 
It gives rise to diffusion in crystals, protein folding, and is closely related to 
activated chemical reactions. Fluctuating systems of interest are often far 
from thermal equilibrium, as in the case of lasers, pattern forming systems 
[1], parametrically driven trapped electrons [2], and systems which display 
stochastic resonance [3]. Important contributions to the theory of fluctua- 
tions in nonequilibrium systems have been made by Lutz Schimansky-Geier, 
to whom this book is dedicated. 

Understanding large fluctuations requires theoretical and experimental 
study of: 

• fluctuation probabilities, i.e. the probability density p(q) for a system 
to occupy the state q far from the attractor q^°^ in phase space. For 
nonequilibrium systems there is no universal relation from which they 
can be obtained, cf. [4]. 

• paths along which the system moves in response to random forcing. The 
distribution of fluctuational paths is a characteristic of the fluctuation 
dynamics. This distribution sharply peaks at a certain optimal path along 
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which the system is most likely to move in an occasional event where it 
fluctuates to a vicinity of a given state q far from the attractor. 

• response of the fluctuation probabilities to external fields. As we will see, 
this response is determined by the optimal paths. It may be exponentially 
strong and may display resonant frequency dependence. Its understand- 
ing paves the way for controlling fluctuations. 

The fundamental role of the distribution of fluctuational paths was rec- 
ognized by Onsager and Machlup [5] who obtained optimal paths for a linear 
Markov system in thermal equilibrium with the bath. A theory for nonlinear 
nonequilibrium Markov systems was developed by Wentzell and Freidlin [6] 
(see also [7-9]). For equilibrium systems the optimal path to a given state 
is the time-reversed path from this state to the stable state in the neglect 
of fluctuations. This is no longer true for nonequilibrium systems, because, 
in general, they lack time reversibility, as demonstrated in Ref. [10]. Even 
for simple nonequilibrium systems the pattern of optimal paths may have 
singular features. 

Much progress has been made over the last decade in the theory of large 
fluctuations, and many interesting results were obtained through digital and 
analog simulations [11]. However, with a few important exceptions [12, 13], it 
was not until recently that systematic experimental work on large fluctuations 
has occurred [2, 14, 15]. In this article we will summarize some of the recent 
theoretical and experimental results. 

In Sec. 2 below we present a general formulation of the problem of large 
fluctuations, escape from a metastable state, and optimal paths for systems 
driven by Gaussian noise. In Sec. 3 this formulation will be used to show that 
escape probabilities can be exponentially strongly changed by a comparatively 
weak ac field even if the field frequency is of the order of the relaxation rate. 
In Sec. 4 we describe the technique of trapping a pm-size dielectric particle 
in an optically created double-well potential, and provide the results of a 
quantitative test of the Kramers escape theory. In Sec. 5 results on interwell 
transitions in a periodically modulated double- well optical trap are presented. 
Sec. 6 contains concluding remarks. 

2 Large Fluctuations Induced by Gaussian Noise 

Gaussian noise is one of the most general types of noise. Therefore, within 
a phenomenological description of noise-induced fluctuations in dynamical 
systems, it is of utmost interest to analyze systems driven by Gaussian noise. 
A natural theoretical approach to the problem relies on the path-integral 
technique [8, 16-20]. We will give a closed-form formulation for a fluctuating 
system which is described by one dynamical variable q [21]. This formulation 
generalizes the results [20] for stationary systems to the case of periodically 
driven systems. The Langevin equation of motion is of the form: 

q = K{q-t) + f{t), K{q;t + TF) = K{q-,t), 



( 1 ) 
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where Tp is the period of the driving field, and f{t) is a stationary Gaussian 
noise (“colored”, in the general case). Such noise is fully characterized by the 
correlation function 0(t) = (/(t)/(0)) or the power spectrum <P(u;) which is 
a Fourier transform of 

For weak noise intensities, over the noise correlation time tcorr and the 
characteristic relaxation time in the absence of noise trei, the system will 
approach the stable state and will then perform small fluctuations 

about it. To arrive to a remote point qf at the instant tf, the system should 
have been subjected to finite forcing over certain time. Different realizations 
of the force f{t) can result in the same final state, but each of them gives 
rise to a certain system trajectory q{t) [22], which is independent of the 
characteristic noise intensity D = max #(w). The probability density of 
realizations of f{t) is given by the functional 

V[f(t)] = exp dtdt' - t')f{t') , (2) 

where fi(t) is a reciprocal of the noise correlation function f dti P{t — 

If the noise intensity D is sufficiently small, then for all f{t) which result 
in a large fluctuation to a given state, the values of the functional (2) are 
exponentially small. For different f{t), they are exponentially different. Thus 
one would expect that there exists a realization f{t) = fopt{t) which is ex- 
ponentially more probable than the others. This optimal realization provides 
the maximum to V subject to the constraint that the system (1) is driven to 
a designated state qf. The path qopt{t) along which the system moves when 
driven by the optimal force foptit) is the optimal fluctuational path. 

From (2), the paths qopt, /opt provide the minimum to the functional 

\ I p dtdt' f{t):Fit-t')f{t') 

+ P dtX{t)[q-K(q-,t)-fit)] (3) 

{ti -oo). The Lagrange multiplier A(t) relates the optimal paths fopt{t) 
aJid qopt(t) to each other. 

It is straightforward to obtain from (3) the variational equations for 
9opt(^)j /opt(^), Aopt(t). Care has to be taken when the boundary conditions 
are discussed. In the problem of reaching the state 9/ at a time tf, they take 
the form 

f{t) —>-0 for t ±00, A(f) 0 for t — > —00, (4) 

X(t)=0 for t>tf, q(t) q^°^(t) for t ^ - 00 , q(tf)^qf. 

The motion of the system after tf is not important from the viewpoint of the 
fluctuation probability. Therefore the constraint on f(t) is lifted for t > tf 
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[20]. Clearly, the force decays to zero for t > tf. However, for a non-white 
noise, it does not become equal to zero instantaneously. 

The boundary conditions for the escape problem are different. Here, the 
optimal escape path corresponds to q{t) approaching the saddle-type periodic 
or stationary state for t — > oo, and > 0 for f — >• oo [20]. 

From (2), the probability density for a system to be brought to the state 
qf ai tf is of the form 

p{qf,tf) oc exp [~R{qf,tf)/D], R{qf,tf) = Tl[qopt, fopt] = mm7l[q,f]. (5) 

The criterion of applicability of the approach is 1. 

In the important case where the noise f{t) is white, we have = 5{t). 
Therefore /opt(*) = Kpt{t), and the variational problem (3) is reduced to 
the Wentzell-Freidlin functional R[q] = (1/2) J dt[q — K{q\t)]‘^ [6], For K 
independent of t, the optimal path is given by qopt = —K{qopt)- 

Noise color and time dependence of K make optimal paths much more 
complicated. Generally, the variational equation 6R = 0 with boundary con- 
ditions (5) has several solutions. The physically meaningful solution provides 
the absolute minimum to the functional R-. Onset of multiple solutions is 
signaled by vanishing of an eigenvalue of the operator 6'^TZ/6xi{t)Sxj{t) {xi 
is q,f,X for i = 1,2,3, respectively), which also shows where the pattern 
of extreme paths has caustics. In contrast to standard nonlinear dynamics, 
caustics are not encountered by “true” optimal paths which minimize R. 

3 Logarithmic Susceptibility 

The general formulation of Sec. 2 allows us to investigate how the probabil- 
ities of large fluctuations are changed by an external field. This is necessary 
for controlling fluctuations. Of utmost interest is the case where the field is 
dynamically weak, i.e. the dynamics of the system is only weakly perturbed, 
and in particular the number of attractors or saddle states is not changed. 
Yet the effect of such field on the fluctuation probability may be strong [23- 
25]. Of particular interest is the effect of an additive periodic force F{t). In 
the equation of motion we set (1) 

K{q-, t) = Ko{q) + F{t), F{t + tf) = F{t) . (6) 

The force F{t) changes the activation energy R{qf,tf) for reaching a state 
qf (5). To the lowest order in F, the increment 6R can be easily obtained 
from the variational formulation (3), 

SR{qf,tf)=f dtx(t)F{t), x{t) = (7) 

J — OO 

where Aq (t) is the solution of the variational problem for reaching the state 
qf in the absence of the driving F. 
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The increment 6Ris linear in F. Even though it is small compared with 
R, it may be much bigger than the noise intensity D, in which case the 
fluctuation probability is changed by the force exponentially strongly. This 
change is fully described by the logarithmic susceptibility x(t) (7) [23,24], 
The above arguments apply also to the problem of escape, in which case 
one should set the upper limit of integration in (7) tf oo. However, care has 
to be taken here of the fact that the optimal path for escape is an instanton. 
The function Xo{t) is other than zero in a time interval on the order of 
the correlation time of noise or the relaxation time of the system, and it 
is exponentially small otherwise. At the same time, the optimal fluctuation 
may occur at any time to, in the absence of periodic driving. The fleld F{t) 
lifts this time degeneracy. It synchronizes optimal escape trajectories (one 
per period) so as to minimize the activation energy of escape. Therefore one 
may expect that the change of the escape activation energy 

/ OO 

dtx{t - to)F{t). (8) 

■oo 

A derivation for white-noise driven systems is given in [24]. 
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Fig. 1. The logarithm of the time-average escape rate IT as a function of the scaled 
amplitude 2|Fi \/D of the driving field F{t) = 2Re [Ti exp(iwFf)] for an overdamped 
Brownian particle. The curves a to d refer to the dimensionless frequency uf = 
0.1, 0.4, 0.7, 1.2, and Ko{q) = —g + q^ in Eq. (6). Inset: time dependence of the 
logarithm of the instantaneous escape rate for the same frequencies and 2\Fi\/D = 
10 {(j> = upt), illustrating loss of synchronization of escape events with increasing 
ujf (optimal escape paths remain synchronized) [25] 



The increment (8), although linear in the field amplitude, is essentially 
nonanalytic in the field. A counterintuitive feature of this expression is that 
the escape rate is modified exponentially strongly even where the field fre- 
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quency largely exceeds the escape rate. This is qualitatively different from 
the situation considered in “conventional” stochastic resonance, where the 
analysis is limited to the low-frequency adiabatic modulation, and the escape 
rate is determined by the instantaneous barrier height. 

Using the logarithmic susceptibility, one can find not only the exponent, 
but also the prefactor in the escape rate, and thus obtain a complete nonadi- 
abatic solution of the escape problem for an overdamped periodically driven 
system [25]. The prefactor problem has attracted much attention since the 
Kramers paper [26] where it was considered for systems in thermal equilib- 
rium. Much work was done to generalize the Kramers results to nonequi- 
librium Markov systems ([27] and references therein). A driven overdamped 
system is the prototypical nonequilibrium system where an explicit solution 
was obtained both for the exponent and the prefactor [25]. We note that the 
technique [25] can be generalized to other systems where escape occurs over 
an unstable limit cycle. 

The explicit solution [25] shows how the time dependence of the instan- 
taneous escape rate W{t) varies with field frequency ujp- For small cjp, the 
time dependence ofW(t) is exponentially strong, W oc exp[-KF'(t)/jD] where 
K = J dtx(t)- For higher field frequencies, it becomes much weaker, as seen 
from Fig. 1. 

4 Testing Kramers’ Theory of Escape 

A simple physical system which embodies fluctuation-induced escape is a 
mesoscopic particle suspended in a liquid and confined within a metastable 
potential well. The particle moves at random within the well until a large fluc- 
tuation propels it over an energy barrier. An optically transparent dielectric 
sphere can be readily trapped with a strongly focused laser beam, creat- 
ing an optical gradient trap, i.e. “optical tweezers” [28]. Techniques based 
on optical tweezers have found broad applications in contactless manipula- 
tion of objects such as atoms, colloidal particles, and biological materials. 
Fluctuation-induced escape can be studied using a dual optical trap gener- 
ated by two closely spaced parallel light beams, as illustrated in Fig. 2. Such 
trap was implemented initially to study the synchronization of interwell tran- 
sitions by periodic forcing [29]. 

A particle in a double- well trap can be used to understand transition rates 
in a stationary potential, and thus to provide a rigorous test of the multidi- 
mensional Kramers rate theory with no adjustable parameters. It can also be 
used to investigate transition rates in an ac-modulated potential. Quantita- 
tive measurements require that the confining potential be adequately char- 
acterized and under the control of the experimentalist. 

In our experiment [14], each of the two focussed beams produces a stable 
three-dimensional trap as a result of electric field gradient forces exerted on 
a transparent dielectric spherical silica particle of diameter 2R = 0.6 p.m. 
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Pig. 2. Rendering of two focused laser beams, the equilibrium positions of the 
particle (rings), and a transitional path between the beams 



Displaced typically by 0.25 to 0.45 pm, the beams create a double-well po- 
tential, with the stable positions of the particle center at ri and T 2 . The 
stability perpendicular to the beam axis is due to the Gaussian transverse 
beam profile gradient; in the beam direction the potential gradient is derived 
from the strong focusing of the objective lens [28]. Relatively infrequent ther- 
mally activated random transitions between the potential wells occur through 
a saddle point at as depicted in Fig. 2. The experimental setup is discussed 
elsewhere [14]. 

The experimental outputs are the three spatial coordinates of the center 
of the particle sampled at 5 ms intervals r(tj). The particle spends most 
of its time in the vicinity of the stable points ri and T 2 with infrequent 
transitions between them. As a result of the short equilibration time of the 
sphere in water ( 7 ”^ = M/6-rr'qR ~ 10“^ s, where 7 / is the viscosity of water 
and M is the particle mass), the velocity of the Brownian particle relaxes to 
equilibrium on a scale much shorter than the sampling time. The stationary 
spatial probability density is 

p(r) = exp[-C/ (r)/fcijr] . (9) 

Eq. (9) enables us to compute, from the observations of the particle fluc- 
tuations, the full three-dimensional confining potential V{r). Results for a 
particular two-beam trap are shown in Fig. 3. We choose the x axis to be in 
the direction from one beam to the other and the ^ axis along the beams’ 
propagation direction. The potential minima, ri and T 2 , lie in the symmetry 
plane y = 0 formed by the beam axes. Fig. 3a shows a 2-dimensional cross- 
section, at 2 / = 0, of the potential with energy contours at 1.0 ksT intervals, 
distinguished by differing shading. If, for a given x, we find the minimum of 
U{t) over y and z, we obtain the familiar one-dimensional representation of 
a double-well potential shown in Fig. 3b. In the j/-direction, the potential has 
only one well, as seen from Figs. 3c, d. 

The striking feature of the effective potential evident in Fig. 3a is the 
strong symmetry breaking about the focal plane, which is the symmetry 
plane of the beams, unperturbed by the particle. The symmetry breaking 
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leads to the single saddle point in U{r) instead of two saddle points as might 
be inferred from Fig. 2. This aspect of the potential is not an artifact of 
specific experimental conditions, such as non-parallel optical beams, but is 
a consequence of the beam-particle interaction. The dielectric particle acts 
as a spherical lens to refocus the beam inside the sphere. When the particle 
is displaced in the +z direction above the focal plane, the electromagnetic 
field is most strongly ’’squeezed” into the particle, thus minimizing the free 
energy of the polarized particle in the field. 

In the vicinity of ri, T 2 , and r*, the potential U{r) is quadratic in the 
displacements 5r = r - rj with i = 1,2, s. In order to obtain the eigenvalues 
of the corresponding quadratic form for a given potential, we performed 
a least-squares fit to the data in the vicinity of Tj. The characteristic fre- 
quencies |iUj| are small compared to the damping rate 7 , so the particle is 
overdamped. 

A quantitative description of thermally activated escape from a one- 
dimensional metastable potential was given by Kramers [26] and subsequently 
extended to multidimensional potentials [30]. For an overdamped Brownian 
particle in a potential U{r), the Kramers transition rate is 



exp i-AUIkeT) , 






2TT7 ’ 



(10) 



where AU is the height of the potential barrier, whereas and char- 
acterize, respectively, the curvatures of the potential at the saddle point and 
at the minimum from which the system escapes, in the normal jth directions, 
with < 0. Therefore, with knowledge of the potential, not only the 

exponential term, but also the prefactor can be explicitly computed. 

Eq. (10) was tested by systematically varying AU. The transition rates 
^rmeas ^gj -0 obtained from the mean dwell time in each state (or by fitting an 
exponential to a histogram of dwell times) as a function of AUlksT. The data 
demonstrate the Arrhenius-like character of the rates. A more definitive test 
is shown in Fig. 4. Here, the Kramers rates, , calculated from Eq. (10) 
using the experimentally determined curvatures, are plotted along the vertical 
axis vs. on the horizontal axis. The solid line of slope one denotes the 

coincidence of theory and experiment. The data fall remarkably close to the 
line, yielding a striking confirmation of the multidimensional Kramers theory 
of transition rates [26]. 



5 Dynamical Symmetry Breaking 

and ac-Induced Localization of a Particle 

We now discuss observations on modulation of escape rates by an ac-field. The 
effect is particularly interesting for a particle in a spatially periodic potential, 
as it gives rise to directed diffusion [31]. It follows from the results of Sec. 3 
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Fig. 3. The potential energy of the particle in the double-well trap as determined 
by experiment, (a) Energy contours for a cross-section in the x — z plane containing 
the two stable points and the saddle point, (b) The energy, minimized with respect 
to y cind z, as a function of x. (c) Same as in (a), but in the y — z plane, (d) The 
energy, minimized with respect to x and z, as a function of y [14]. 



that, for a generic periodic potential, an ac field performs more work on the 
particle as it moves along the optimal escape path in one direction than in 
the other, thereby more strongly reducing the corresponding potential barrier 
and producing diffusion in that direction. 

An effect closely related to directed diffusion but more amenable to testing 
using optical trapping is ac-field induced localization in one of the wells of a 
symmetric double-well potential. We expect both these effects to occur if the 
applied field breaks the spatio-temporal symmetry of the system [23, 32-34], 
The ratio of the stationary populations wi , W 2 of the wells is determined by 
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Fig. 4. Comparison of the measured transition rates and the rates calculated 

from the three-dimensional Kramers theory, , using the measured curvatures 
of the potential wells. The squares represent escapes from the well at ri and the 
triangles represent escapes from the well at rj. The line of slope one indicates the 
result expected if the three-dimensional Kramers theory correctly predicted the 
measured transition rates [14] 



the ratio of the rates Wij of the interwell transitions, 

wi/w 2 = W 21 IW 12 oc exp([^(ZlJ7i) - S{AU 2 )] /ksT), (11) 

where S{AUi, 2 ) are field-induced corrections to the activation energies of 
escape from the wells 1,2, which are given by (8). 

The experiment is conducted by setting the static barrier height AUi = 
AU 2 = AUq w SksT. Optical intensity of a beam is then modulated by 
an electro-optic device, giving rise to modulation of the reduced barrier 
height AUlkeT with an amplitude w 2.5. The modulation frequency w/27t 
is varied between 1 to 100 Hz. This may be compared to the mean unmod- 
ulated transition rate W ~ 0.1s“^ The form of the modulation is AU{t) = 
AUo + A[sin(wt) -I- (1/2) sin(2u>t -I- 4>)]. A useful feature of this waveform is 
the presence of the control parameter (j). As shown in the insets to Fig. 5, 
the sign of the barrier height shift during the first part of the cycle can be 
inverted between left and right hand wells if the phase angle is shifted by tt. 
The potential is not invariant under f— ^f-|-7r/a;,r— > — r (with r measured 
from the inversion center in the absence of modulation), and this leads to 
breaking of the spatial symmetry over a cycle of the modulation. 

The modulation of the escape rates results in unbalanced averaged occu- 
pation probabilities of the left and right wells. In the experiment, they differ 
by 20% for the modulation amplitude used. This is sufficient to create sig- 
nificant directional diffusion, and demonstrates onset of dynamical symmetry 
breaking. 
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Phase of modulation (radians) 

Fig. 5. Plots of the time-dependent switching probabilities out of a double-well 
potential over a cycle uit of the modulating waveform. The upper and lower panels 
show the role of the phase angle <p in controlling the transition rates. Solid lines show 
the theoretical results based on Eq. (8). Insets show the instantaneous difference 
between the heights of the potential barriers in the two wells. 



6 Conclusions 



In summary, we have shown how to describe the dynamics of large fluctu- 
ations. It follows from the results that the response of fluctuation proba- 
bilities to an ac-fleld can be described in a fairly universal way using the 
notion of logarithmic susceptibility. Even where this quantity may not be 
calculated, it can be measured experimentally and then used for selective 
control of fluctuations. We have also shown that thermal fluctuations can be 
used to measure the complete confining potential of a particle in an optical 
trap. Our results provide a direct quantitative confirmation of the full three- 
dimensional Kramers theory of transition rates, throughout a broad range of 
barrier heights and potential well shapes, measured independently. By mod- 
ulating the barrier height with a weak biharmonic waveform, the particle can 
be induced to favor occupying a particular well in a symmetric double-well 
potential. This dynamic symmetry breaking is readily controlled by manipu- 
lation of the relative phase of the two components of the waveform. 
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Abstract. Noise-induced escape from a non-hyperbolic attractor, and from a quasi- 
hyperbolic attractor with nonfracttd boundaries, is investigated by means of ana- 
logue experiments and numerical simulations. It is found that there exists a most 
probable (optimal) escape trajectory, the prehistory of the escape being defined by 
the structure of the chaotic attractor. The corresponding optimal fluctuational force 
is found. The possibility of achieving analytic estimates of the escape probability 
within the framework of Hamiltonian formalism is discussed. 



1 The Escape Problem for Chaotic Systems 

There have been recently a number of interesting studies of the interplay of 
noise with chaotic behaviour [1, 2] including e.g. a demonstration of chaotic 
features in a purely stochastic Kramers oscillator [3], the phenomena of both 
noise-induced instability [4] and noise-induced order [5] , noise-induced chaos 
[6] and quantum noise-induced chaotic oscillations [7]. However, the analytic 
estimation of the probability of noise-induced escape from the basin of attrac- 
tion of a chaotic attractor remains an unsolved fundamental problem in the 
theory of fluctuations [8,9]. It is of broad interdisciplinary interest in view 
of a host of important applications including e.g. stabilisation of the voltage 
standard [10], neuron dynamics [11], and laser systems [12]. 

It has now been established, however, that the fluctuational dynamics of 
escape can be investigated directly through measurements of the prehistory 
probability distribution [13-16]. The underlying idea is based on the con- 
cept of large fluctuations [17], in which the system fluctuates to the remote 
state along an optimal path. Mathematical equivalents of this physical con- 
cept are asymptotic equations for the solution of the Fokker-Plank equation 
written in the form of rays (Hamilton equations), or wavefronts (Hamilton- 
Jacobi equation) [18]. In this method the dynamical variables of the system, 
and sometimes also the external force, are recorded simultaneously, and the 
statistics of all actual trajectories along which system evolves to a given state 
are then analyzed [13]. The advantages of this technique were demonstrated 
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earlier [15, 16,21] by investigation of some fundamental symmetry properties 
of optimal trajectories and the singularities in their distribution. 

In the present paper we use measurements of the prehistory probability 
distribution for the direct experimental investigation of fluctuational escape 
from a chaotic attractor and discuss the possibility of achieving analytic es- 
timates of the escape probability within the framework of Hamiltonian for- 
malism in the context of our results. We study two systems with different 
attractors: a non- hyperbolic attractor in a nonautonomous nonlinear oscilla- 
tor; and a quasi-hyperbolic attractor in the Lorenz system. 



2 Escape from a Non-hyperbolic Attractor 



2.1 The Model 

We first investigated the stochastic dynamics of a periodically driven nonlin- 
ear oscillator with equation of motion 



q = K(q,t) -l-f(t), 

K = {Ki,K 2 } = {q2,-2rq2-ulqi - ^q\ - jq^ +hsm{uft)}, 



9 

r<Uf, T7^<-^<4. 

10 



mm) = D6{t) = 4rkTd{t), 



( 1 ) 



Parameters were chosen so that the potential is monostable < 47 ^ 0 ) 
and the dependence of the energy of oscillations on the frequency is non- 
monotonic This model is encountered in many applications and 

allows a theoretical analysis to be carried out over a wide range of parameter 
values (see e.g. [22-24]). It was shown earlier [23] that chaos in (1) arises for 
relatively small driving force amplitudes h « 0.1. 

A simplified bifurcation diagram obtained by numerical simulation is 
shown in Fig. la. Boundaries of the hysteresis of the period 1 resonance 
are shown by full lines, and those of the period 2 resonance by dotted lines. 
Chaotic states are indicated by small pluses. The region of coexistence of the 
two period-2 resonances is bounded by the dash-dotted line. 

The bifurcation diagram shown in Fig. lb for one set of parameters ex- 
plains some of the notation used in Fig. la. Thus arrows 3 and 9 indicate 
the boundaries of stability of the large stable limit cycle of period 1 and cor- 
respond to the filled circles in the Fig. la. In particular it can be seen: that 
there are two coexisting limit cycles of period 2; and that the chaotic state 
appears via a sequence of period-doubling bifurcations and thus corresponds 
to a non-hyperbolic attractor [25], i.e. to a chaotic attractor (CA) consisting 
of both stable and unstable sets. 

We note that the bifurcation diagram shown in Fig. la is in qualitative 
agreement with earlier theoretical predictions [23]. The working point P was 
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Fig. 1. (a) A two-dimensional bifurcation diagram of the system (1) on the 
plane obtained from numerical simulations with F = 0.025, wo = 0.597, /3 = 1,7 = 
1. Regions of chaos are shown by crosses. Regions where two attractors corre- 
sponding to the resonances of period 1 coexist are shown by dots. Circles in- 
dicate the boundaries of the hysteresis corresponding to the period 2 resonance. 
The region where two period 2 attractors coexist is shown by triangles (the full, 
dashed-dotted and dashed lines are guides to the eye). The working point P with 
uif = 0.95, h = 0.13 shown by bold plus was placed in the region of coexistence 
of the period 1 stable limit cycle and of the chaotic attractor, (b) A bifurcation 
diagram obtained in Poincar^ cross-section for t = nuj//27r,n = 0, 1..., w/ = 1.005 
shows values of gi as a function of amplitude h. Arrows 1 and 4 indicate the region 
of hysteresis for the period 2 resonance corresponding to the circles in Fig. la. The 
region of coexistence of the two resonances of period 2 is shown by arrows 2 and 
5 corresponding to the triangle in Pig. la. The hysteresis for the large stable limit 
cycle of period 1 is indicated by arrows 3 and 9 corresponding to the filled dots in 
Fig. la. Arrows 6-9 show the boundaries of the chaotic states 





chosen to lie in the region where the chaotic attractor coexists with the 
stable limit cycle. This regime is often of interest from the point of view of 
applications (see e.g. [11,26-28]). 

The escape process has been studied through both analogue electronic [29] 
and digital simulations. The latter employed the prescriptions of [30], given 
that simulation times necessarily grow exponentially as T 0. Both tech- 
niques yielded qualitatively similar results, but the data shown here are digi- 
tal, because precision is of particular importance. The basins of attraction of 
the coexisting chaotic attractor CA and large stable limit cycle SCI are shown 
in Fig. 2 for the Poincare cross-section w/t = 0.67r(mod27T) in the absence 
of noise. The value of the maximal Lyapunov exponent for the CA is 0.0449. 
The symbols UCl in the figure denote saddle cycle of period 1 which lies on 
the boundary between the basins of attraction of CA. The stable manifolds 
of cycle UCl define the boundary of basins. 

In the presence of noise there is a finite probability of noise-induced tran- 
sitions between CA and SCI. The intersections of one of the actual escape 
trajectories are shown in Poincare cross-section by the filled circles. The sad- 
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Fig. 2. The basins of attraction of the stable limit cycle SCI (shaded) and CA 
(white) for a Poincare cross-section with w/i = O.Q‘K{mod2n), u>f — 0.95. The 
saddle cycle of period 1 UCl is shown by the filled square, and that of period 3 
UC3 by the pluses. Intersections of the actual escape trajectory with the Poincare 
cross-section are indicated by the filled circles. 



die cycle of period 3 UC3 is shown in the figure by pluses. Multipliers for 
UC3 are = 0.04873 < 1 and fi 2 = 7.608312 > 1. It is evident that the 
actual escape trajectory passes very close to UC3 (see also below). 



2.2 Theoretical Approach 

In the limit of small noise intensity, deep insight into the fluctuational dynam- 
ics of escape can be gained within the framework of Hamiltonian formalism. 
To appreciate what physical picture of escape from CA might be expected, 
we first consider the simpler process of escape from a stable limit cycle SC 
bounded by an unstable cycle UC. The system will spend most of its time 
fluctuating in the close vicinity of the limit cycle, only occasionally fluctu- 
ating far away towards the boundary of its basin of attraction. But when 
these large rare fluctuations do arise, they occur in almost deterministic way: 
escape from a domain of attraction typically occurs along a unique trajec- 
tory (see e.g. [31-34]). For the stable limit cycle this physical picture was 
confirmed in numerical simulations [10,26]. In general the escape will take 
place along the unique most probable escape path (MPEP). The probability 
of escape along the MPEP p(q) in the limit of small noise intensity can be 
written in the form [18] (see also [13, 15-21]) 

p(q) « constant x exp(— 5(q)/A:r), T 0. (2) 

5(q) is an “activation energy” of fluctuations to the vicinity of the point 
q in the system state space. Expression (2) is an analogue of the WKB 
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approximation for the corresponding to (1) Fokker-Plank equation. 

P=fvV-V-(pK). (3) 

5(q) may be viewed as a classical action, because to leading order it satisfies 
an eikonal (Hamilton-Jacobi) equation of the form 



S + H 




= 0 , 



H — 2Fp\ 4-piATi +P 2 K 2 , 



q = 



dH 
dp ’ 





P = {Pl,P2] = 



dS 

aq’ 



( 4 ) 



where H so-called Wentzel-Preidlin Hamiltonian [18]. The optimal fiuctu- 
ational trajectories are projections onto the coordinate space of the classical 
trajectories determined by this Hamiltonian. They correspond to extreme 
values of the action functional in the form [35] 



5[q(t)] = 




K2{q{t))]^dt. 



( 5 ) 



In general, the computation of the most probable escape path qop< (t) requires 
a minimization over the set of the extreme trajectories which spiral from the 
stable limit cycle SC qsc (at t,- -> — 00 ) to the unstable cycle UC quc (at 
tf -¥ 00 ). This trajectory may be found as the solution of a boundary problem 
for the system (4) with the corresponding boundary conditions in the form 

• _ Q f q(i«) qsc, p(k) -> o for ti -00 . . 

<5q(t) ’ \ q(t/) -> qi/c, p(^/) ->-0 for ty ->■ 00 ^ 

Thus the MPEP is a heteroclinic trajectory of least action of the Hamiltonian 
dynamical system associated with (1). 

In fact, equations (4) describe extreme fluctuational paths. Optimal paths 
provide the global minimum to the action 5[q]. It is clear from (2) that, for 
small T, it is these optimal paths that possess physical significance; extreme 
paths are not necessarily physically significant. For small noise intensity, the 
probability of escape along the MPEP is exponentially small; but it is ex- 
ponentially more probable then the probability of escape along any other 
trajectory, including the other heteroclinic trajectories of (4). This is the 
optimal path observed in a physical experiment. 



2.3 Experimental Approach 

To investigate the dynamics of large fluctuations one may use an experimen- 
tal approach in which one accumulates information about all arrivals of the 
system in the close vicinity of a chosen state q/. In our experimental tech- 
nique [13] we monitor continuously the dynamical variables ( 51 ,^ 2 ), and the 
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random force until noise-induced escape takes place. We store the rele- 
vant part of the escape trajectory and noise realization 
and then reset the system once more to the chaotic attractor. An ensemble- 
average of such trajectories built up over a period of continuous monitoring 
creates the prehistory probability distribution [13] Note that 

it differs from the ordinary conditional probability distribution and that it 
sets optimal paths into a physical context; their physical significance follows 
from the fact that p/i(q, t; q/, f/) at any given moment of time t should have 
a sharp maximum in q lying on the optimal path, q - qopt(f|f/, q/); and the 
optimal path is in fact just the Z) — > 0 limit of the ridges of the prehistory 
distribution. By investigating the prehistory probability distribution exper- 
imentally, one can establish the area of phase space within which optimal 
paths are well defined, i.e. where the tube of fluctuational paths around an 
optimal path is narrow. The prehistory distribution thus provides information 
about both the optimal path and the probability that it will be followed. 

We note that the existence of most probable escape trajectories, as well as 
the validity of the eqs. (2,4) was confirmed earlier in analogue experiments for 
a number of non-chaotic systems(see e.g. [15, 16, 21] and references therein). 

2.4 Results of the Experimental Approach 

We now return to consideration of escape from a basin of attraction of CA. 
Since the the basin of attraction is bounded by the same saddle cycle UCl 
one may expect that near the UCl the situation will be qualitatively the 
same and that there exists a unique MPEP near UCl. The situation is qual- 
itatively different near a chaotic attractor. Analysis of the Hamiltonian flow 
in this region is practically impossible and there are no predictions about the 
character of the distribution of the optimal trajectories near a non-hyperbolic 
attractor. According to the simplest scenario the MPEP smears out near CA 
and no unique escape path exists in this region. However, a statistical analysis 
of actual fluctuational trajectories reveals a different and much more detailed 
physical picture of the noise-induced escape from a CA. 

We have investigated some thousands of actual escape trajectories for the 
system (1), for different sets of parameters. Fig. 3a presents typical results 
for the parameter values corresponding to the operating point P shown in 
the Fig. la and a noise intensity T 0.001. The most probable escape paths 
found in the experiment are shown in Fig. 3a by the dotted, dashed and 
full lines. The probability of escape along first path (dotted) is in 9.5 and 
2.375 times larger then escape along the second (dashed) or third (full) paths 
respectively. All the escape paths merge at the saddle cycle of period 3 UC3. 
If the noise intensity is reduced further one of the escape paths becomes 
exponentially more probable then the others. In what follows we concentrate 
on the properties of this most probable first escape path. 

Fig. 3a also shows (thin full lines) 15 measured fluctuational escape tra- 
jectories corresponding to an optimal path. All the actual trajectories were 
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Fig. 3. (a) Three optimal escape trajectories from the non-hyperbolic attractor to 
the stable limit cycle, found in numerical simulations with T « 0.001, are shown 
by the full, dashed, and dotted lines respectively. The triangles and filled circles 
show one period each of the unstable saddle cycles of period 3 (UC3) and 1 (UCl), 
respectively. The thin full lines show 15 real escape trajectories corresponding to 
the same optimal trajectory, (b) The most probable escape path from the non- 
hyperbolic attractor to the stable limit cycle, found by use of the prehistory prob- 
ability distribution for T ss 0.0005, is shown by the full line. Single periods of the 
unstable saddle cycles of period 5, 3 and 1 are shown by open circles, squares and 
triangles respectively; the stable limit cycle is shown by rhombs. Parameters used 
for the simulations in both (a) and (b) were h = 0.13, w/ « 0.95, wo w 0.597. 



shifted in time so that the characteristic regions of the trajectories corre- 
sponding to the transition from chaotic to regular motion coincide with each 
other. It can be seen from the figure that these trajectories follow closely 
one and the same optimal escape path. Because of this fact it is possible to 
determine the optimal escape path by simple averaging. 

A statistical analysis of the data - the actual fluctuational trajectories [29] 
and corresponding noise realizations - reveals the following scenario of escape 
from the basin of attraction of the non-hyperbolic attractor (see Fig. 3b). The 
system comes first to UC5, the saddle cycle of period 5 embedded in CA, and 
then slides down the unstable manifold of this cycle. At this moment the 
system is driven by noise to the period 3 saddle cycle UC3, which is not 
part of the non-hyperbolic attractor and can be considered as its boundary. 
Next, the fluctuations drive the system from the period 3 saddle cycle to the 
boundary of the basin of attraction of CA. Thus the problem of escape from 
a non-hyperbolic attractor can be considered in terms of fluctuational tran- 
sitions between a few saddle cycles of low period, UC5 -> UC3 UCl. The 
results obtained are in qualitative agreement with the well known statement 
that saddle cycles provide a detailed invariant characterization for dynamical 
systems of low intrinsic dimension (see e.g. [36]). 

The fact that fluctuational escape from a non-hyperbolic attractor can be 
described in terms of transitions between just a few cycles opens up the pos- 
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sibility of an analytic estimate of the escape probability through an extension 
of the recent theory of the logarithmic susceptibility [19, 20] to the systems 
with limit cycles (M.I. Dykman and V.N. Smelyanskiy, private communica- 
tion). In this approximation the escape probability from a non- hyperbolic 
attractor can be represented as the product of the probability of staying on 
the saddle cycle and the probability of a transition between cycles. The latter 
probability can be expressed analytically in terms of the known velocity of 
relaxation between limit cycles with rotational symmetry. 

Simultaneously with measurement of the optimal path, we have found 
the optimal force by simple averaging of noisy realizations. The optimal force 
(Fig. 3(b)) consists of two parts corresponding to escape to the saddle cycles 
UC3 and UCl. It tends to zero after achievment of the saddle cycle UCI. 

3 Fluctuational Escape 

from a Quasi-hyperbolic Attractor 

We now consider for comparison a fluctuational escape from the Lorenz at- 
tractor, which is a quasi-hyperbolic attractor consisting of unstable sets only. 
This system[37] is of interest because it describes e.g. convective fluid dy- 
namics, as well as the single mode laser[38] and is often used as an example 
of a classical system with chaotic dynamics: 

q = K(q) + f(t), 

K = {Ki,K 2 ,Kz} = {(r(q 2 - qi),rqi -92 -Qiqz,qiq 2 -bqa}, 

f(t) = {o,o,?(f)}, m)=o, mm) = D5{t), (?) 

For simplicity we consider the noise to act through the third equation only. 
For cr = 10, 6 = 8/3, r = 24.08, (7) has three attractors [37]: the stable 
points Pi and P 2 and the Lorenz attractor (Fig, 4(a)). The stable manifolds 
of the saddle cycles Li and L 2 surround the stable points and they constitute 
boundaries between the chaotic and regular regimes in this region of phase 
space. The Lorenz attractor is an aggregate of integral curves going from 
Li to L 2 and back, the saddle point O, and its unstable one-dimensional 
manifolds (separatrices) A and F 2 . Note that the probability of trajectories 
passing near the separatrices and the cycles Li and L 2 is practically zero for 
the noise-free system. Like escape from a non-hyperbolic attractor, there is 
no theoretical prediction about the process of fluctuational escape from the 
Lorenz attractor. But the process is readily studied via numerical simulation 
and the method of analysis described above in relation to escape from a non- 
hyperbolic attractor. For definiteness, we examine escape to the stable point 
Pi. The averaged escape trajectory cind corresponding averaged fluctuational 
force obtained in this way are shown in Fig. 4b. 

We have found that escape occurs via the following scenario. The es- 
cape trajectory starts from the stable manifold of saddle point O. Under the 
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Fig. 4. (a) The structure of phase space of the Lorenz system. An escape trajectory 
measured by numerical simulation is indicated by the filled circles, (b) The averaged 
escape trajectory (full line) and the averaged fluctuational force (dashed line). 



action of a fluctuation, an escape trajectory tends to point 0 along the two- 
dimensional stable manifold. Then, without reaching the saddle point 0, the 
trajectory departs from it again, following a path close to the separatrix F2 , 
and falling into the neighborhood of the saddle cycle Li . In the absence of the 
external force, the trajectory goes away from the cycle Li , slowly untwisting. 
The fluctuational force induces a crossing through the saddle cycle, and the 
trajectory then relaxes to the stable point Pi. We can thus split the escape 
process into two parts: fluctuational and relaxational. Practically all of the 
fluctuational part belongs to the Lorenz attractor, and itself consists of two 
stages: first, the fluctuational force throws the trajectory as close as possible 
to the cycle Li ; secondly, the trajectory crosses this cycle under the action of 
fluctuations. The first stage is defined by the stable and unstable manifolds 
of the saddle point 0, and the time-dependence of the fluctuational force 
is similar to that of the coordinate qs (Fig. 4b). During the second stage. 
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the fluctuations have a component which oscillates in anti-phase to the co- 
ordinate Q 3 . Because the trajectory of the noise-free system departs from the 
cycle Li very slowly, the fluctuational force inducing the crossing through the 
cycle may start to act at any time during a long interval. For this reason the 
averaged fluctuational force itself consists of a long oscillating function. 

Practically all of the escape trajectory from the Lorenz attractor lies on 
the attractor itself. The role of the fluctuations is, first, the delivery of the 
trajectory to a seldom-visited area in the neighborhood of the saddle cycle 
Li, and secondly, the inducing of a crossing cycle Li. So we may conclude 
that the role of the fluctuations is different in this case, and the possibility 
of applying the Hamiltonian formalism will require a more detailed analysis 
of the crossing process. 

In future investigations we plan to carry out more detailed statistical anal- 
yses of fluctuational trajectories and noise realizations to define the optimal 
force, because the simple averaging of noise realizations does not provide a 
very accurate result. 



4 Summary 

In summary, we have found that the mechanisms of escape from a non- 
hyperbolic attractor and a quasi-hyperbolic (Lorenz) attractor are quite dif- 
ferent, and that the prehistory of escape reflects the different structure of 
their chaotic attractors. The escape process for the non- hyperbolic attrac- 
tor is realized via several steps, which include transitions between low-period 
saddle-cycles co-existing in the system phase space. The escape from the 
Lorenz attractor consist of two qualitatively different stages: the first is de- 
fined by the stable and unstable manifolds of the saddle center point, and lies 
on the attractor; the second is the escape itself, crossing the saddle boundary 
cycle surrounding the stable point attractor. The corresponding optimal force 
was measured in both cases. We have shown that the mechanism of escape 
from the non-hyperbolic attractor may be amenable to a theoretical anal- 
ysis within the framework of the Hamiltonian approach. Finally, note that 
our central results were obtained via an experimental definition of optimal 
paths, confirming our experimental approach as a powerful instrument for 
investigating noise-induced escape from complex attractors. 
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for Systems Far from Equilibrium 
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Abstract. The development of a general statistical physics of nonequilibrium sys- 
tems was one of the main unfinished tasks of statistical physics of the 20th century. 
The aim of this work is the study of a special class of nonequilibrium systems where 
the formulation of an ensemble theory of some generality is possible. These axe the 
so-called canonical-dissipative systems, where the driving terms are determined by 
invariants of motion. We construct canonical-dissipative systems which are ergodic 
on certain surfaces on the phase plane. These systems may be described by a non- 
equilibrium microcanocical ensemble, corresponding to an equal distribution on the 
target surface. Next we construct and solve Fokker-Planck equations; this leads to 
a kind of canonical-dissipative ensemble. In the last part we discuss the thoretical 
problem how to define bifurcations in the framework of nonequilibrium statistics 
and several possible applications. 



1 Introduction 

The development of the statistical mechanics of equilibrium systems was 
started in the pioneering work of Gibbs and belongs to the great achievements 
of natural science in the twentieth century (Gibbs, 1931). The development 
of a corresponding statistical theory of states far from equilibrium started 
with Boltzmann’s and Einstein’s work but due to great principal difficulties 
the theory is still far from final solutions. (Einstein, 1926; Bogoliubov, 1946; 
Subarev, 1976, Klimontovich, 1995; Schimansky-Geier and Pbschel, 1997). A 
successful approach based on the ensemble idea was developed by Zubarev, 
Ropke, Morosov and others (Zubarev et al., 1996, 1997); this approach how- 
ever is limited so far to near equilibrium systems. We will show here that there 
exists a special class of far from equilibrium systems, the so-called canonical 
dissipative systems, where also an ensemble theory similar to Gibbs approach 
may be developed (Haken, 1973; Graham, 1973, 1981; Hongler and Ryter, 
1978; Ebeling and Engel-Herbert, 1980; Feistel and Ebeling, 1989; Ebeling, 
Schweitzer and Tilch, 2000). This theory is in close relation to a recently de- 
veloped theory of active Brownian particles (Schweitzer et al., 1998; Ebeling 
et al., 1998, 2000; Erdmann et al., 2000). 

The theory of canonical-dissipative systems is the result of an extension of 
the statistical physics of Hamiltonian systems to a special type of dissipative 
systems where conservative and dissipative elements of the dynamics are both 
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determined by invariants of the mechanical motion. In recent work (Makarov 
et ah, 2000) the special properties on canonical-dissipative systems were used 
to find exact solutions for dissipative solitons in Toda lattices which are 
pumped from external sources with free energy. Here we aim to contribute to 
the general theory of a statistical mechanics of canonical-dissipative systems. 

2 Dynamics of Canonical-Dissipative Systems 

We start the development of the theory with a study of the phase space dy- 
namics of a driven many-particle system with / degrees of freedom z = 1, ..., /. 
Assuming that the Hamiltonian is given by H(qi...qfpi...pf) the mechanical 
motion is given by Hamiltons equations. The solutions are trajectories on the 
plane H = E = const. The constant energy E = H(t — 0) is given by the 
initial conditions, which are (in certain limits) arbitrary. We construct now 
a canonical-dissipative system with the same Hamiltonian (Graham, 1973, 
1981) 



dt 



dH dH 

oqi dpi 



( 1 ) 



In general we will only assume that g{H) is a nondecreasing function of the 
Hamiltonian. The new equation which we call canonical-dissipative system 
does not conserve the energy. In regions of the phase space where g{H) is 
positive, the energy decays and in regions where g{H) is negative, the energy 
increases. The simplest possibility is constant friction g{H) = 70 > 0 which 
corresponds to a decay of the energy to the ground state. Of more interest is 
the case when the dissipative function has a root y(£Ji) = 0 at certain given 
energy E\ . Let us assume further that at least in certain neighbourhood of 
El the function g{H) is increasing. With this assumptions the states with 
H < El are supported with energy and from the states with H > Ei energy 
is extracted. Therefore any given initial state with H{G) < Ei will increase 
its energy up to reaching the shell H{t) = Ei and any given initial state 
with H{0) > El will decrease its energy up to the moment when the shell 
H{t) = El is reached. Therefore the solution of eq. (1) converges to the 
surface H = Ei. On the surface H = Ei itself the solution corresponds to 
a solution of the original Hamiltonian equations for H = Ei. The simplest 
dissipation function with the wanted properties is a linear function 



g{H)=c{H-Ei) (2) 

Evidently any state with H (0) < Ei will increase its energy up to reaching 
the shell H{t) = Ei and any state with Lf(0) > Ei will decrease its energy 
with a rate proportional to the difference H - Ei. The process comes to rest 
when the shell H (t) = E\ is reached. The relaxation process is proportional to 
c~^. The linear dissipative function (2) has found applications to Toda chains 
(Makarov et ah, 2000). More general dissipative functions were considered in 
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the theory of active Brownian motions (Schweitzer et al., 1997; Ebeling et 
al., 1998, 2000). We mention that all noninteracting systems with g = g{p^) 
are of canonical-dissipative type. 

A more general class of canonical-dissipative systems is obtained, if beside the 
Hamiltonian also other invariants of motion are introduced. Let us assume 
that the driving functions depend on some set of other invariants of motion 
Io,h,h,--,Is for example 

• Iq = H - Hamilton function, 

• Ii = P - total momentum of the system, 

• I 2 = L - total angular momentum of the system, etc. 

For the equation of motion we postulate 

dpi ^ dH dG{h,h,h,...) , . 

dt dqi dpi 

Using this generalized canonical-dissipative formalism, the system may be 
driven to certain subspaces of the energy surface, e.g. the total momentum 
or the angular momentum may be prescribed. Assuming quasi-ergodicity we 
may assume that in the long run the measure of the trajectories is equally 
distributed on certain shells around the surfaces 



H{qi...qfpi...pf) = const (4) 

Ikiqi-QfPi'-Pf) = const, k = 1,2, ,.s (5) 

The idea about the ergodicity of the trajectories leads us to the microcanon- 
ical ensembles discussed in the next section. 



3 The Microcanonical Nonequilibrium Ensemble 

There exist several examples of physical systems which are nearly uniform 
in space but nevertheless far from equilibrium. One particular example is a 
laser plasma created by a strong laser pulse. Other representative examples 
are fluids showing homogeneous turbulence and systems of active Brownian 
particles which were discussed in our previous work (Schweitzer et al., 1967; 
Ebeling et al., 1998, 2000; Erdmann et al., 2000). All these systems have in 
common, that they are driven by energy supply to far from equilibrium states 
which are near to certain total energy Ei . 

We construct now a special non-equilibrium ensemble which is character- 
ized by a constant probability density on a energy shell 

El - ijE < H{qi...qfpi...pf) < Ei + ^SE 



( 6 ) 
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This is a rather restrictive assumption, in particular it means that due 
to the symmetry of the system all mean fluxes are zero. However as demon- 
strated above such nonequilibrium systems exist and may be used as models 
for real systems. 

The mean energy of the ensemble is fixed 



<H>=Ei=U (7) 

and the entropy is given by the volume of the energy shell 1? according to 
Boltzmann’s formula 



S = kB\ogO{Ei) ( 8 ) 

Since our system is not in thermal equilibrium, the usual thermodynamic 
relations in particular the relation between entropy, energy and temperature 
are not valid. For a system in thermal equilibrium at temperature T the 
following relations hold: 






dU 


(9) 




(10) 


dS 1 


(11) 


dU~f 



The most typical properties of an equilibrium ensemble is, that the mean 
energy is proportial to the noise level T and that the mean quadratic de- 
viation (5H)'^) is proportional to T^. In the equilibrium all energy comes 
from the thermal fluctuations. In nonequilibrium the energy of the nonlinear 
excitations and the noise energy are decoupled. In other words, the energy 



{H)=U ~ Ex (12) 

is given mostly by the properties of the energy source and is nearly indepen- 
dent of the noise level which we will denote from now by D. On the other 
hand the dispersion of the energy fluctuations is constant (nearly independent 
of the energy of the excitations). 

{SE'^) = ((H^) - {Hf) = const (13) 

We see immediately that the canonical distribution 

Po{qx-qfP\-Pf) = const.exp (14) 

is not compatible with the two properties (12,13). For the same reason also 
other exponential distribution functions derived from the maximum entropy 
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principle will not apply. However by construction we may easily obtain distri- 
bution functions with the correct behaviour of the mean and the dispersion. 
The most simple example is the Gaussian distribution 



Po{q-L—qjPi—P}) = const, exp 




2D } 



(15) 



Here c is some constant and D will later be related to the noise strength. 
We study as an example a d-dimensional nonequilibrium gas. Just as an 
illustration we also may think about a crowd of walkers moving stochastically 
on a big square, or on a swarm of birds moving stochastically without a 
concrete target. The Hamiltonian is 



N 



^ ^ 2m 



(16) 



The microcanonical nonequilibrium ensemble is then a thin shell around 
the surface of an A/'d-dimensional sphere in the momentum space with the ra- 
dius (2m£i)^/^ . The thicknes of the shell is given as an independent quantity 
by the noise strenght < (^£)^ D. 

In a typical microscopic state all particles move with constant modulus 
of the velocity 



The direction of the velocities fluctuates stochastically. A physical system 
which behaves in such a way is a fluid in the state of uniform turbulence. 
Other examples are strongly excited laser plasmas and active Brownian par- 
ticles. 

In a generalization of the approach described above we assume that beside 
the energy also some other invariants of motion as e.g. the momentum or 
the angular momentum are conserved. Then the generalized microcanonical 
ensemble assumes that the probability density is constant in the following 
shells 



El - ^SE < H{qi...qjpi...pf) < Ei ]^5E (18) 

h - < h{qi-qfPi -Pf) <h + ^Slk (19) 

This means that the density is concentrated on certain subspace of the energy 
shell. We note that the invariants we consider are not necessarily smooth 
functions, even fractal structures are admitted. Fluxes may be prescribed 
as far as they are expressed by invariants of motion. Another form of the 
distributions are the Gaussians 
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Po(qi'-'qfPi--Pf) 



const. exp 



f ih{qi-qf,Pi-Pf) - Ik?) 

V 2D 



( 20 ) 



4 Stochastic Theory of Canonical-Dissipative Systems 

We use here the standard approach based on Langevin and Fokker-Planck 
equations. We restrict our study now to the case were the dynamics is deter- 
mined by only one invariant of motion namely H. The Langevin equations 
are obtained by adding a white noise term to the deterministic equations 

The essential assumption is, that noise and dissipation depend only on 
H. The corresponding Fokker-Planck equation reads 



dp 

dt 






dpi dqi 



.j^dH dp d 

^ dqi dpi ^ dpi 



+ ( 22 ) 



An exact stationary solution is 



Po(gi-9/Pi-P/) = Q ^exp (23) 

The derivative of po vanishes if g{H) = 0. This means the probability is 
maximal at the surface H = E\. 

For the special case of a linear dissipation function we find a stationary 
solution which corresponds to the ensemble eq. (15) 

Po{qi -qfPi-Pf) = exp (24) 

In the limit of very strong driving the probability reduces to a kind of mi- 
crocanonical ensemble corresponding to the energy Ei and a constant proba- 
bility density on a shell. In this way we come back to the ensemble which we 
postulated in the previous section. Another case of interest is the combination 
of a linear driving 

g{H)^Go{\+giH) (25) 

and a linear noise strength 

D{H) = Do{\ + diH) (26) 



This leads to the distribution 
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Po{qi...qfPi...pf) = Q ^exp 




Gq9i 

Dodi 





log(l + diH) 



(27) 



Similar distributions were used in the context of active Brownian motion 
(Erdmann et al., 2000). The existence of exact solutions for the probability 
distributions admits to derive the thermodynamic functions as the mean 
energy 



U = Q-^ I dHJ{H)H exp 1^'' dH' (28) 

where the Jacobian is defined by 

dqi...dqfdp\...dpf = J{H)dH (29) 

The entropy follows from the Gibbs formula which yields here 

5 = +kslnQ - kB I dHJ(H) exp (30) 

The system has further a Lyapunov functional K which is provided by 
the Kullback entropy 

K[p,Po] = j dqi...dqfdpi...dpfp\og\p/po] (31) 

This gives explicitly 

K[p, Pol = InQ - S/kB + {j^ 1^) (32) 

This functional is always nonincreasing and the expression 

< 0 (33) 

plays the role of the evolution criterion for our dissipative system. 



5 Discussion 

This work is devoted to the study of canonical-dissipative systems which are 
pumped from external sources with free energy. We started our work from the 
Hamiltonian theory for conservative mechanical systems. In order to extend 
the known solutions for conservative systems to non-conservative systems we 
used the general theory of canonical-dissipative systems. Special canonical- 
dissipative system are constructed which solution converges to the solution of 
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the conservative system with given energy, or other prescribed invariants of 
motion. In this way we are able to generate nonequilibrium states character- 
ized by by certain prescribed invariants of mechanical motion. We postulated 
certain distributions which are analogues of the microcanonical ensemble in 
equilibrium. Further we found solutions of the Fokker-Planck equation which 
may be considered as analogues of the canonical equilibrium ensembles. We 
propose to call these distributions canonical-dissipative ensembles. By the 
help of the different nonequilibrium ensembles we were able to construct for 
canonical-dissipative systems a complete statistical thermodynamics includ- 
ing explicite expressions for energy, entropy etc. and an evolution criterion 
for the nonequilibrium. 

As a possible theoretical application of nonequilibrium ensembles we mention 
the development of a theory of bifurcations far from equilibrium along the 
lines developed in earlier work (Ebeling, 1978; Horsthemke and Lefever, 1986; 
Malchow and Schimansky-Geier, 1985; Tolstpjatenko and Schimansky-Geier, 
1986; Ebeling et ah, 1990). If u is the set of parameters of the problem then 
according to (Ebeling et al. 1990) the stochastic bifurcation set consists of 
two branches: 

• The set of topological changes of the distribution 



AT = [u : dipo = 0,det{dijpo) = 0] (34) 

• The set of the topological changes of the probability flow in the subspace 
of the coordinates 






with i = 1,2,...,/ and in the subspace of the momenta 
Gf = 



dH dH 

—po - g{H)—po - D{H) — 

dqi dpi dpi 



(35) 



(36) 



The bifurcations of this vector field may be determined by standard meth- 
ods of qualitative analysis. A full analysis of these problems is possible since 
explicite expressions for the probability distributions and the probability 
flows are available and we may study their topological changes in detail. 

As one of the most important practical applications of a theory of canonical- 
dissipative type we consider problems of active Brownian motion including 
biological motion and traffic. Active Brownian particles are particle-like ob- 
jects with the ability to take up energy from the environment. Simple models 
of active Brownian particles were studied in many earlier works (Steuernagel 
et al., 1994; Schweitzer and Schimansky-Geier, 1994; Klimentovich, 1995; 
Viscek et al., 1995; Bier and Astumian, 1996). Most near to canonical dis- 
sipative systems are the models of Brownian particles with negative friction 
(Steuernagel et ah, 1994, Schweitzer et ah, 1996; Erdmann et ah, 2000) Some 
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of this work was devoted to the investigation of particles which are able to 
store the inflow of energy in an internal depot and to convert internal energy 
to perform different activities (Schweitzer at al., 1998). Other previous ver- 
sions of active Brownian particle models (Schweitzer and Schimansky-Geier, 
1994) consider specific activities, such as environmental changes and signal- 
response behavior. In these models, the active Brownian particles (or active 
walkers, within a discrete approximation) are able to generate self-consistent 
fields, which in turn influences their further movement and physical or chem- 
ical behavior. This non-linear feedback between the particles and the field 
generated by themselves results in an interactive structure formation process 
on the macroscopic level. Hence, these models have been used to simulate a 
broad variety of pattern formations in complex systems, ranging from phys- 
ical to biological and social systems (Schimansky-Geier and Poschel, 1997). 

We have to underline, that canonical-dissipative systems are a class of 
models. In reality, canonical-dissipative systems strictly according to their 
definition, practically do not exist. However there are many complex systems 
and among them systems of central importance which have several properties 
in common whith canonical-dissipative systems as 

• the mechanical character of the motion, i.e. the existence of space and 
momentum, of quasi-newtonian dynamics etc., 

• the support of the dynamics with free energy from internal or external 
reservoirs and the existence of mechanisms which convert the reservoir 
energy into acceleration. 

If so; then the question arises, how systems near to having canonical-dissipative 
character can be treated by some kind of perturbation theory. Methods to 
develope such a perturbation theory were developed in (Haken, 1993; Ebel- 
ing, 1981). 

Summarizing we would like to state, that canonical-dissipative systems, 
inspite of their rather academic definition, deserve the interest of researchers 
in the field of complex dynamics and promise important applications. 



It remains to the author to express his sincere thanks to LSG for a long- 
lasting fruitful and pleasant collaboration in the field of problems discussed 
here. 
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Stochastic Approach to Lyapunov Exponents 
in Coupled Chaotic Systems 



Riidiger Zillmer, Volker Ahlers, and Arkady Pikovsky 

Department of Physics, University of Potsdam, Potsdam, D-14415, Germany 



Abstract. We use linear stochastic Langevin equations to describe the Lyapunov 
exponents in coupled chaotic systems. The largest Lyapunov exponent is calcu- 
lated analytically, using the stationMy solution of the Fokker-Planck equation. For 
small couplings we reproduce the singularity which was first described by Daido as 
the effect of coupling sensitivity of chaos. The singularity is shown to depend on 
the coupling and the systems’ mismatch. The analytical results are confirmed by 
numerical simulations. 



1 Introduction 

Irregular dynamics of chaotic systems suggests their statistical description 
with the methods of statistical physics. Although the distribution function of 
a chaotic signal can be hardly approximated as the Gaussian one (the varia- 
tions of a dynamical process are bounded), in the situations where the first 
moments (usually, the mean value and the variance) are of major importance, 
the modelling of a chaotic process with a stochastic one is beneficial. As an 
example we can mention statistical description of transitions inside chaos, 
such as synchronization transition [1,2]. 

Here we describe the stochastic approach to the calculation of Lyapunov 
exponents in coupled systems [3]. The largest Lyapunov exponent measures 
the growth rate of infinitesimal perturbations to chaotic trajectories and 
serves as one of the most important characteristics of chaotic motion, in 
numerics it is a standard tool for proving the existence of chaos. Moreover, 
many physically relevant properties of chaos, like the correlation time, en- 
tropy, synchronization threshold, depend on the largest Lyapunov exponent. 

An interesting anomaly in the behavior of the largest Lyapunov exponent 
happens if the two chaotic systems are weakly coupled. This is the effect of 
coupling sensitivity of chaos, first observed by Daido [4-6] (see also [7,8]): 
the dependence of the largest Lyapunov exponent on the coupling parameter 
e has a singularity ~ 1/| lne| for small couplings e -4 0. 

Here we describe an analytical approach based on the modeling of the 
perturbation dynamics in coupled systems with a set of linear stochastic 
equations (recently such an approach has been applied to coupled map lat- 
tices [9]). For this set we get an analytical expression for the largest Lyapunov 
exponent, valid for arbitrary coupling and systems’ parameter mismatch. This 
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allows us to show that the logarithmic singularity disappears if the interact- 
ing systems have different exponents. Apart from the analytical treatment, 
we present simple arguments explaining the singularity form with the help of 
elementary random-walk dynamics. 

2 Stochastic Continuous-Time Model 

In this section we formulate a stochastic continuous-time model for coupled 
chaotic systems. First, we neglect the high-dimensionality of the interacting 
chaotic systems and describe linear perturbations in each system with a scalar 
variable. In other words, we are following the perturbation corresponding to 
the largest Lyapunov exponent only. Second, we model the fluctuations of the 
growth rate with a stochastic multiplicative term in the equations of motion. 
This approach has been succesfully applied in studies of different statisti- 
cal properties of chaos [1,10]. Summarizing, we propose the two-dimensional 
system of Langevin equations (in the Stratonovich sense) 

= (Xi(0 + + £(^2 - iq), (la) 

= iX2{t) + A2 )u2 + e{u\ — U2) (lb) 

as a continuous-time model for the linearized equations of coupled chaotic 
systems. Three groups of parameters describe three important ingredients of 
the dynamics: 

Lyapunov exponents of uncoupled systems are described by the constants 
Ai,2. 

Fluctuations of local growth rates are modeled with the terms Xi,2{t) 
which are random processes with zero mean values. In order to be able 
to apply the powerful theory of the Fokker-Planck equation [11], we as- 
sume furthermore these processes to be independent, Gaussian, and delta- 
correlated 



ixi) = 0 , {Xi{t)Xj{t’)) = 2a^6ij6{t - t') . 

The parameters <Ti 2 describe the fluctuations of local expansion rates in 
the chaotic systems. The quemtities ctj 3 can be put in direct correspon- 
dence to the uncoupled chaotic systems, if one calculates the distribution 
of local (finite-time) Lyapunov exponents (see, e.g., [12]). Such a distri- 
bution has the asymptotic (for large time intervals T) form 

Prob(Ax) ~ ^ 

with a scaling function ^ having its minimum at the true Lyapunov ex- 
ponent A. Physically, the scaling function 0 describes the distribution of 
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the finite-time Lyapunov exponents, taking into account their correlations 
as well. Typically, it is bounded between the smallest possible and the 
largest possible Lyapunov exponents. For the stochastic model (la), (lb) 
the local Lyapunov exponents are finite-time averages of the Gaussian 
delta-correlated process, so that their distribution is also Gaussian: 

Prob(AT)~e-^(^--^)'(^")‘'. 

This means that we in fact use the parabolic approximation of the func- 
tion (p and get the parameter from this function: 

a-"* = 

Coupling is described by the last terms on the r.h.s., it is proportional to 
the coupling constant e. For a while a symmetrical coupling is assumed, 
the case of asymmetrical coupling is considered in Sec. 5 below. 

Note that in this formulation we assume the statistical properties of the 
underlying chaotic motion to be independent of the coupling: the parameters 
yli ,2 and the statistical properties of the fluctuations xi ,2 are e-independent. 
This assumption is supported by the theory [13], where the invariant mea- 
sure for weakly coupled systems is constructed using perturbation methods, 
so that the measure has no singularities in dependence on e. Thus the theory 
below is valid as soon as we can neglect e-dependence of the statistical prop- 
erties of chaos compared to singular e-dependence of the largest Lyapunov 
exponent. 



3 The Fokker-Planck Equation 
and the Lyapunov Exponents 

Before writing the Fokker-Planck equation for the stochastic system (la,lb), 
we perform a transformation to new variables. First we note that for large 
times and positive coupling e both variables ui ^2 have the same sign. Indeed, 
it is easy to see that the regions U\,U 2 > 0 and Ui,U 2 < 0 are absorbing 
ones because for ui = 0 we have iii = eu 2 and for U 2 = 0 we have ii 2 = £U\ . 
Thus eventually one observes the state with u\U2 >0 independently of initial 
conditions. So the transformation 

Vi = In(ui/W2), V2 = ln(iiiU2), 

can be performed, leading to the equations 

^ = 6 - 2esinh(t;i) + Ai - A2, (2) 

at 

^ = 6 + 2ecosh(t;i) Ai+ A2- 2e, (3) 
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where — xi ~ X 2 and ^2 = Xi + X 2 - One can see that the dynamics of 
vi is U 2 -independent, thus, although the noisy forcing terms ^ 1,2 are no more 
statistically independent, we can deduce from (2) the Fokker-Planck equation 
for the probability density [11]: 



P = 



2ecosh(t;i) + 2£sinh(i;i)-- (Ai 

OVi 



dv\_ 



where = (af + <T 2 )/ 2 . 

The stationary solution of (4) is given by 



(4) 



Pstat(«i) = C'exp(/ui -ecr ^ coshwi), 



where 



Ai — A2 

2(t2 ’ 



(5) 



with the normalization constant C. 

Basing on the solution (5) we now calculate the largest Lyapunov ex- 
ponent \max (below we omit the index, denoting the largest exponent for 
simplicity as A), defined by 



The norm u\ -f Uj can be expressed in terms of vi and V 2 as 
ln(uf -h U 2 ) =V 2 + ln(2 coshni) . 



Since one is interested in the large-time limit, the stationary distribution of 
vi may be used. Because (ln(2coshrJi))p^,^,(„j) is finite and time-independent, 
the only contribution to the largest Lyapunov exponent comes from V 2 - Thus 
Eq. (3) gives the equation for A: 



1 1 
= 2 ^^ 2 ) = e(coshui) + - {Ai + A 2 - 2e) . 

The averaging with the stationary distribution Pstat(^^i) yields 



( 6 ) 



(coshui) 






where Ki are modified Bessel Functions (Macdonald Functions) [14], Substi- 
tuting this in (6) we obtain a final analjdical formula for the largest Lyapunov 
exponent. We write it in a scaling form: 

X-l{A^+A2-2e) _ e + -f^i+|/|(£/0 

<72 a2 2if|,|(£/<72) • 

This form demonstrates that the essential parameters of the problem are the 
coupling parameter and the Lyapunov exponents’ mismatch normalized to 
the fluctuation of the exponents: efa^ and I = {Ai - A 2 )/{ 2 a‘^), correspond- 
ingly. 

Simplified expressions can be obtained in the following limiting cases: 
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Small coupling, equal Lyapunov exponents. According to (5), if the Lyapunov 
exponents of two interacting systems are equal, Ai = A 2 = A, then the 
parameter I vanishes and we get (cf. [9]) 

Kiie/a"^) 



A = e 



Koie/a^) 



— s . 



For small coupling e/cr^ the leading term in e is singular, as it follows from 
the expansions of Ki and Kq [14]: 



A- A 



|ln(e/a2)| • 



(8) 



This formula corresponds to Daido’s singular dependence of the Lyapunov 
exponent on the coupling parameter[4-6j. It is valid in all cases, when iden- 
tical chaotic systems are coupled symmetrically, provided that the Lyapunov 
exponents in these systems fluctuate (a^ > 0). Moreover, even for different 
systems having however equal Lyapunov exponents (but not necessarily equal 
fluctuations of the exponents) we get the same singularity as for identical sys- 
tems. 



Small coupling, different Lyapunov exponents. The expansion (8) remains 
valid for small values of mismatch |/|, if is close to 1. For larger 

mismatch, when 




the largest Lyapunov exponent is 



2(7^ 



| A1-N) ( 
'r(i + i 






^''1 l/M 

+ 5 ( 1/11 



A 2 I + Ai +A 2 ) 



The singularity is now of the power-law type, with the power depending on 
the system’s mismatch. Note also that this is the correction to the largest of 
the Lyapunov exponents of uncoupled systems + 1 , 2 - 



Large coupling. For e/cr^ > 1 the expansion of (7) gives 

, (l+3f2)rr4 1 

A«y-^-g^ + 5(Ai+A2). 

From the Fokker-Planck equation approach we have obtained the largest 
Lyapunov exponent. The second exponent can be found as follows. For the 
stochastic system (la,lb) the mean divergence of the phase volume is 

d 



dt 



dill dii2 
dui ^ du2 



lnV) = (^ + ~) = Ai+A2-2e, 



and this quantity is just the sum of the Lyapunov exponents. Thns 

A2 — — Ai -f- Ai -f- A2 — 



( 9 ) 



and we get for A 2 the same singularity as for the largest exponent, only with 
another sign. 
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4 A Qualitative Picture 



(a) 





Fig. 1. A sketch of the perturbation dynamics in coupled systems. Curly line shows 
the random walk not influenced by coupling; straight arrows demonstrate the effect 
of coupling. 



Here we give qualitative arguments supporting the main singularity for- 
mula (8). Let us consider the symmetric case and small couplings (moreover, 
for simplicity of presentation we assume 4 = 0). For small s, the coupling in 
the system (la, lb) influences the dynamics only if the difference between Ui 
and U 2 is large. E.g., if U 2 ~ Ui/e >> ui, then the coupling term in the first 
equation (la) is of the same order as other terms and it contributes to the 
growth of the variable ui. At the same time the influence of ui on U 2 remains 
small. Thus, the coupling “switches on” only rarely, but leads to effective 
equalization of the variables where the smallest one is adjusted to the largest 
one. We illustrate this process in Fig. 1(a). 

To make these arguments quantitative, let us represent the same qualita- 
tive picture in the plane of logarithmic variables Inuj, lnu 2 [see Fig. 1(b)]. 
Here we have a random walk in two dimensions, and this walk is restricted 
to the strip jlnui — lnu 2 | < — Ine. The walk has rather strange properties 
of reflection at the boundaries: it jumps to the diagonal Inui = lnu 2 , always 
in the direction of growth of Inui and lnu 2 . Due to these reflections a con- 
stant drift arises, whose velocity is easy to estimate. Indeed, for an unbiased 
random walk starting at the center of the strip the mean time to reach the 
boundary is (lne)^/cr^ [15], and this is a characteristic time between reflec- 
tions. Each reflection makes a contribution of order of j Ine | to the mean drift. 
So for the mean drift velocity w'e get cr^/j Inej in accordance with (8). 
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5 Asymmetrical Coupling 

The more general case of asymmetrical coupling can be described by the 
following set of Langevin equations: 

— = (xi(0 +^i)*^i +£i(w 2 — Ui) , (10a) 

at 

^ = (X2(i) + ^2)«2 + £ 2(^1 - U 2 ) . (10b) 

at 

By virtue of the scaling transformation 

Ul = ^/e^Ul, U2 = V^U2, (11) 

the problem can be reduced to the symmetric case: 

^1 = (xi + -di — £i + \/eTe^)ui + •\/£i£2(u2 ~ ui) t 
U2 = (X2 + A 2-62 + \/ei£2)u2 + v'£l^(ftl “ ^ 2 ) • 

Thus, we can use the expression (7) for the largest Lyapunov exponent, lead- 
ing to 

Ai - |(yli + A 2 - El - £ 2 ) _ y/ei £2 ■ft^l-|<|(\/£l£ 2 /g^) + -ffl + |f|(\/gl£2/<7^) 
cr2 ~ 0-2 2K\ii(y/e^/a^) 

Here the effective mismatch and the effective coupling are now given by 
I = ~ (^2 - £ 2 )] , s = VsTs2 . 

In the case of unidirectional coupling the ansatz (11) is no more valid, but in 
this situation the Lyapunov exponents can easily be found directly. If, e.g., 
£i = 0, then the Lyapunov exponents are A\, /I 2 — £ 2 - There is no singularity 
for unidirectional coupling. 

The results for asymmetrical coupling can straightforwardly be under- 
stood in the framework of the qualitative picture of Sec. 4. Indeed, the impor- 
tant quantity is the width of the strip in Fig. 1(b), and this is — (Inei -l-lne 2 ). 
In the limiting case of unidirectional coupling the width tends to infinity, the 
random walk never hits the boundary, and there are no essential corrections 
to the uncoupled exponents. 

6 Numerical Results 

We now compare the results obtained for the system of continuous-time 
Langevin equations with numerical calculations for the discrete-time deter- 
ministic system of two diffusively coupled one-dimensional maps, 

a;i(n-h 1) = /i(a:i(n)) + e[/ 2 (x 2 (n)) - /i(xi(n))] , (12a) 

2 : 2(71 4- 1) = /2(x2(rr)) -l-e[/i(xi(r7)) - f2{x2in))] , (12b) 
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where fi{x) and f 2 {x) are maps specified below. The linearized equations 
read 

wi{n + 1) = (1 - e)fi(xi{n))wi{n) + e/^ (2:2(71) )u;2(n) , (13a) 

W 2 {n+ 1) = (1 - e)f 2 (x 2 (n))w 2 {n) + £f[{xi{n))wi{n) . (13b) 

For the calculation of Lyapunov exponents we iterate the original as well as a 
set of linearized equations, and reorthonormalize the difference vectors peri- 
odically using a modified Gram-Schmidt algorithm (see [16, 17] and references 
therein) . 

The Lyapunov exponents of the uncoupled maps are 7li,2 = (In |/[ 2|)- In 
the simplest examples considered below the variances can be calculated as 
^ 1,2 — 1 / 1 , 2 ! ~ ^i,2)^)/2. To have a good correspondence to the theory, 

we use only monotonous mappings (i.e. with a constant sign of /') below, 
so that the fluctuations of the local expansion rate are the only source of 
irregularity of perturbations’ dynamics. Another source of irregularity could 
be irregular changes of the sign of the derivative /' (as for the logistic and 
the tent maps). Such an irregularity is not covered by our continuous-time 
approach, but also leads to the logarithmic singularity of type (8), see [9]. 



6.1 Skewed Bernoulli Maps 

We first choose fi{x) = f 2 {x) = f(x) to be identical maps, where f{x) is the 
skewed Bernoulli map defined as 




x/xo 

(x - xo)/(l - Xo) 



if X < xo , 
if X > Xo , 



(14) 



with X € [0, 1] and 0 < xq < 1. This map has the uniform invariant measure 
and the subsequent finite-time Lyapunov exponents are uncorrelated. Thus, 
the statistical properties of Lyapunov exponents, including the scaling func- 
tion, can be obtained analytically (see, e.g., [18]). The Lyapunov exponent 
and the magnitude of fluctuations are given by 



A = -Xo In Xo - (1 - Xo) ln(l - xo) 



(15) 



and 

respectively. For xq = 1/2 we obtmn the ordinary Bernoulli map. In this case, 
there are no fluctuations of the local multipliers (<7^ = 0), and no coupling 
sensitivity of the Lyapunov exponents is observed. 

Figure 2 shows the differences Ai_2— Ai,2 vs e for maps with different values 
of Xo 7^ 1/2. Prom Fig. 2 it can be seen that different curves collapse onto 
single lines for both exponents when plotted in the rescaled form according to 
(7), namely as (Ai — Ai)/<r^ vs 1/j ln(s:/cr^)|. The resulting lines are in very 
good agreement with the leading term of the theoretical prediction (Ai - 
A\)jo^ = l/|ln(e/cr^)|, which is also shown. 
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Fig. 2. Coupled skewed Bernoulli maps, Eq. (14). 

(a) The Lyapunov exponents Ai — Ai and A 2 — A 2 vs e for xo = 1/3 (solid lines), 
xo = 1/4 (dotted lines), a:o = 1/5 (dashed lines), and xo — 1/6 (dash-dotted lines). 

(b) The same graphs in scaled coordinates. The long-dashed lines show the ana- 
lytical results (Ai — Ai)/a^ — 1/| ln(e/tr^)| and (A 2 — A 2 )I<j^ = — 1/| ln(e/o-^)|, see 
Eqs. (8) and (9). 

6.2 Different Maps 

One main result of the analytical approach is that the singularity does only 
depend on the average <r^ = (cjj -|-(72)/2 of th® fluctuations of local expansion 
rates and on the mismatch / = (Ai - A2)/(2cr^) of the Lyapunov exponents 
of the uncoupled systems. Although no singularity occurs if <7^ = 0, we can 
expect to observe coupling sensitivity in the case of a system with fluctua- 
tions (cti > 0) coupled to one without fluctuations (crl = 0), given that the 
mismatch I is sufficiently small. 

In order to check this prediction, we again numerically iterate the system 
of Eqs. (12a)-(13a), now choosing two different maps. The first map is again 
the skewed Bernoulli map [/i(x) =; f{x), see Eq. (14)], while the second map 
is defined as 

f 2 {x) — (mod 1) , (16) 

where Ai is the Lyapunov exponent of the skewed Bernoulli map f{x) [see 
Eq. (15)]. With this choice we have the parameters erf > 0, cr| = 0, and I = 0. 

In Fig. 3 the result is compared with the previous result for two coupled 
identical skewed Bernoulli maps (xq = 1/4 in either case). As expected, 
the logarithmic singularity is observed in both cases, although the deviation 
I Ai - Ail is smaller if erf = 0. When rescaled with the average a^, however, the 
curves collapse onto single lines for the first and second Lyapunov exponents, 
as can be seen in Fig. 3(b). 

7 Conclusion 

In this paper we used the Langevin approach to Obtain statistical properties 
of the Lyapunov exponents for small coupling. For the simplest system of 
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Fig. 3. Different maps. 

(a) Ai — yli and A2 — /I2 vs e for two coupled skewed Bernoulli maps with xq = 1/4 
(solid lines) as well as one skewed Bernoulli map with 2:0 = 1/4 coupled with the 
different map (16) (dotted lines). 

(b) (Ai — A\)ja^ and (A2 — A^ja^ vs 1/| ln(e/cr^)| for the same examples as in 
Fig. 3(a). The long-dashed lines show the analytical results as in Fig. 2(b). 



two coupled stochastic equations it is possible to obtain an analytical expres- 
sion for the largest Lyapunov exponent, for different values of parameters 
(coupling, Lyapunov exponents of uncoupled systems, fluctuations of Lya- 
punov exponents). The logarithmic singularity, first discovered by Daido, is 
shown to exist even if rather different systems are coupled, provided their 
Lyapunov exponents coincide. We also give a qualitative explanation of the 
effect, based on the interpretation of the perturbations’ dynamics as coupled 
random walks. The coupling ~ £ restricts the two-dimensional walk to a strip 
with a width ~ loge, with rather unusual “reflection conditions” on the strip 
borders. As a result the random walk (and, correspondingly, the Lyapunov 
exponent) gets a bias ~ (loge)“^. It is not clear, if such an effect can be 
observed in the context of other random-walk-like phenomena. 
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Abstract. In this paper we study properties of hyperbolic and nonhyperbolic at- 
tractors. On the basis of the method proposed in [1] we present a numerical pro- 
cedure to distinguish two types of chaotic attractors in two-dimensional (2-dim) 
invertible maps and in three-dimensional (3-dim) flow systems. We also analyze 
the effect of bounded noise on certain characteristics of nonhyperbolic chaos. We 
compute the stationary probability measure on noisy nonhyperbolic attractors by 
means of two different methods and then compare the obtained results. 



1 Introduction 

Strange attractors in finite-dimensional systems can be divided into three 
main classes: robust hyperbolic, almost hyperbolic (quasihyperbolic) and non- 
hyperbolic [2-4] . The property of robust hyperbolicity of a chaotic attractor 
means that all its trajectories are of the same saddle type, and their stable 
and unstable manifolds are everywhere transversal, i.e, the structure of a hy- 
perbolic attractor is homogeneous in every point on the attractor. Besides, 
these properties are preserved under small parameter variation. However, ro- 
bust hyperbolic attractors are rather ideal objects such as Smale- Williams’ 
solenoid [5] or Plykin’s attractor [6]. The existence of robust hyperbolic at- 
tractor has been proved for none of dynamical systems defined by differential 
equations or discrete maps. Nevertheless, there are several examples of al- 
most hyperbolic attractors, that are the Lorenz attractor [7] in flow systems, 
the Lozi attractor [8] and the Belykh attractor [9] in discrete maps. For these 
systems, the presence of nonrobust singular phase trajectories (separatrix 
loops or homoclinic curves) is typical. However, they do not lead to the birth 
of stable motions. Thus the properties of quasihyperbolic attractors are very 
similar to those of the hyperbolic ones. 

The majority of chaotic attractors of dynamical systems are, however, 
nonhyperbolic [2,3]. Nonhyperbolic attractors include chaotic limit sets as 
well as stable periodic orbits. The latters have very narrow basins of attrac- 
tion and are often difficult to detect in numerical experiments. Nevertheless, 
the properties of nonhyperbolic attractors are essentially different from those 
of hyperbolic attractors [4, 10, 11]. A principal difference is that nonhyperbolic 
attractors exhibit high sensitivity tow£irds small control parameter variations 
or to small noise perturbations, while the characteristics of hyperbolic and 
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almost hyperbolic attractors display smooth dependence on parameters and 
practically are not sensitive to weak noise. 

Generally speaking, the system response to noise perturbations signifi- 
cantly depends on the properties of a system under study [12-14], Many 
different effects can be realized in the system due to even any small noise dis- 
turbance [15-22], In this connection of special interest is the problem of sta- 
tistical properties of dynamical systems with chaotic attractors [23-30] . This 
problem has been basically solved for systems with hyperbolic and quasi- 
hyperbolic attractors [25-28], while it is far from being solved for systems 
with nonhyperbolic attractors [2-4], It is known that small perturbations, 
including noisy, of hyperbolic attractors cause respectively small changes of 
the structure of the probability measure [25,27], By Ya. Sinai’s figurative ex- 
pression, the own dynamical stochasticity of a system turns out to be much 
stronger than that imposed from outside. 

The situation dramatically changes as applied to the systems with nonhy- 
perbolic attractors. In such systems noise perturbations can induce various 
phase transitions [31], Unfortunately, up to now the problem of statistical de- 
scription of nonhyperbolic systems with bounded noise perturbations has not 
been solved theoretically. In particular, there is no proof for the existence of a 
stationary probability measure on nonhyperbolic chaotic attractors without 
noise. 

Since it is important to know first whether a chaotic system is hyper- 
bolic or not, we explore chaotic attractors by applying a numerical procedure 
proposed in [1] for diagnosing the hyperbolicity of chaotic saddles in 2-dim 
systems. In our paper we demonstrate the efficiency of this technique with 
numerical examples for 2-dim maps and then generalize this approach for the 
diagnosis of chaotic attractors in 3-dim flow systems. We also pay our atten- 
tion to the effect of noise on the structure of the angle distribution between 
the manifolds for 2-dim invertible maps. 

In our contribution we also analyze the influence of bounded noise on the 
properties of nonhyperbolic systems and estimate an invariant probability 
measure on noisy nonhyperbolic attractors. For this purpose we explore nu- 
merically some 2-dim dissipative maps. To find the probability distribution 
we employ two different approaches. The first one operates with a long tra- 
jectory of the stochastic equations of the system under study. The second one 
is based on a solution of the equation for the probability density. 



2 Study of Attractor Hyperbolicity 

A direct method for detecting whether or not a chaotic system is hyper- 
bolic, is to calculate the angles (f> between the stable and unstable manifolds 
along a trajectory in points x of the chaotic attractor. This method con- 
sists in the transformation of an arbitrary vector by the linearized evolution 
operator along a trajectory forward and backward which allows to find the 
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angle between the directions of stability and instability for different points 
on the chaotic set. This algorithm enables to establish a homoclinic tangency 
between the manifolds [1]. If the probability of arbitrary small values of the 
angle (f) is finite for a sufficiently large number of points on a chaotic attractor, 
then the attractor is nonhyperbolic. 

We especially analyze chaotic attractors of the two-dimensional invertible 
Henon map [32] 

® "b Unt Vn+l — (1) 

for a = 1.06, b = 0.3, and of the Lozi map 

^n+l — 1 ^|^n| “b Vni f/n+1 — bXji (2) 

for a ~ 1.7, b = 0.3. 

In map (1) the chaotic attractor is typically nonhyperbolic [33], while the 
attractor in map (2) was proved to be quasihyperbolic [8]. The properties 
of the chaotic attractors are determined by the behavior of the invariant 
manifolds of saddle cycles. If these manifolds have a smooth ’’horseshoe” -like 
shape, it can lead to their transversality at the moment of tangency and, 
according to the theorems in [33,34], to the birth of stable periodic orbits. 
This is a characteristic way for the appearance of a nonhyperbolic attractor 
in the Henon map (1). But one can avoid ’’dangerous” tangencies if a map is 
given by piecewise-smooth functions as in the case of the Lozi map (2) [10] . 
The manifolds of saddle cycles have a break and hence, no stable orbits arise. 
Thus, the chaotic attractor is quasihyperbolic. 

We calculate the angles between the stable and unstable manifolds for 
points along a chaotic trajectory for maps (1) and (2). To find the stable and 
unstable directions at a certain point x, we iterate this point forward and 
backward for each map N = 10^ times. The angle probability distribution 
P{(p) for 10^ points on the chaotic set of map (1) is shown in Fig. 1(a) 
by the dashed line. Our calculations have shown that such a view of angle 
distribution is typical for the chaotic attractors in the Henon map. This 
figure gives evidence that the chaotic attractor in map (1) is nonhyperbolic. 
Figure 1(b) illustrates the angle probability distribution calculated for the 
Lozi attractor. It is seen that there is a minimal angle between the stable 
and unstable directions which is considerably larger than zero. 

Thus, we can conclude that the method for calculating angles allows to 
confidently distinguish two types of chaotic attractors. For hyperbolic and 
quasihyperbolic attractors, the angles between the stable and unstable direc- 
tions are uniformly bounded away from zero. If the angles are not bounded 
away from zero, we have strong indications that the chaotic attractor is non- 
hyperbolic. 

It seems quite interesting to study the influence of noise on the evolution 
of angles between the stable and unstable manifolds along a trajectory on the 
chaotic attractor. Obviously, there is no meaning of speaking about manifolds 
in a noisy system. However, the angle between the directions of stability and 
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(a) (b) 





Fig. 1. The probability distribution of 10,000 angles on the Henon attractor for 
a = 1.06, b = 0.3 without noise {dashed line) and in the presence of noise with 
intensity D = 0.28 (solid line) (a) and on the Lozi attractor for a = 1.7, b = 0.3 
(b) (step of binning on <^-axis is 1®) 



instability may be thought of as a certain characteristic of a chaotic trajectory 
of the noisy system. 

Consider the stochastic equations of the Henon map 

Xn+i = a- xl + yn + D^i{n), yn+i = bxn + D^ 2 {n), (3) 

and of the Lozi map 

Xn^-i =1- a\xn\+yn + D^i{n), j/„+i = 6a;„ + L»^ 2 (n). (4) 

The .bounded noise sources ^i(n) and ^ 2 {n) are taken to be statistically in- 
dependent and uniformly distributed in the interval [-0.5, 0.5]. Parameter D 
governs the noise intensity and determines both the variance of the noise and 
the maximal force of random stimuli perturbing the system. The results of 
relevant calculations for the map (3) are shown in Fig. 1(a) by the solid line. 

In the case of the quasihyperbolic attractor in the Lozi map (4) the effect 
of small noise on the angle probability distribution appears to be less essential 
than for the map (3). Our calculations have shown that the angle probability 
distribution P{^) for the Lozi attractor is the same both with and without 
noise perturbations. Hence we can conclude that from a viewpoint of the 
diagnosis of attractor hyperbolicity (nonhyperbolicity), the presence of noise 
does not change the type of a chaotic attractor. 

Now we pass to the analysis of 3-dim flow systems with our technique 
for angle calculation. A speciality of our numerical procedure for calculating 
these angles in 3-dim flow systems is that we consider the transformation of 
an arbitrary vector by the linearized operator forward and backward directly 
along a continuous chaotic trajectory and not in the Poincare section of the 
attractor. In this way, we find two vectors e“ and gr* corresponding to the 
increase and decrease of perturbations, respectively. The third vector is 
directed along the trajectory and corresponds to unchanged perturbation. 
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Pairs of vectors and (e“;e“) define two planes. The angle between 

these planes yields the angle 4> between the stable and the unstable manifolds 
in a point a; on a chaotic trajectory. 

We consider as a first example the Lorenz model [35] described by a system 
of three ordinary differential equations 

x = -(y{x-y), y = rx-y-xz, z=-bz + xy, (5) 

where we fix c = 10 and b — 8/3. For the Lorenz system the existence of 
two types of attractor was proved. These are the well-known quasihyperbolic 
Lorenz attractor (e.g., at r = 27) and a nonhyperbolic attractor for r > 31 
[7,36]. 

We calculate the angles between stable and unstable manifolds for N = 
5 X 10^ steps forward and backward along a chaotic trajectory of system (5) 
with the integration step h = 10“'*. In our calculations the total integration 
time tmax is about 1,500 dimensionless units. For sufficiently large N (we 
took W > 5 X 10*), the vectors e" and £*, which we get at a point x, are good 
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Fig. 2. Calculation results for the Lorenz system and the Rossler system, (a) Min- 
imal angle (pmin as a function of the parameter r (cr = 10, b = 8/3) for the Lorenz 
system; (b) the angle probability distribution for the Lorenz attractor at r = 27; 
(c) the distribution for the nonhyperbolic attractor in system (5) for r = 51; (d) 
the probability distribution of angles on the chaotic attractor in the Rossler system 
for a = 0.2, fj, = 5.0. The step of binning on i^axis is 1° 
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enough approximations of the unstable and stable directions at this point. 
Then the angle variation along a trajectory is a smooth function of time. 

Our technique allows to classify the attractor type and to diagnose tran- 
sitions between different attractor types as the system’s parameter is varied. 
Figure 2(a) shows the dependence of minimal angle on the control parameter 
r. The minimal angle decreases abruptly when we approach the boundary 
of the transition from the Lorenz attractor to the nonhyperbolic attractor. 
This point identified with our technique is in good agreement with that one 
calculated theoretically (shown in Fig. 2(a) by the dashed line) by using a 
criterion of the sign change by the separatrix quantity [36] . 

Figures 2(b) and 2(c) show typical probability distributions of angles on 
the quasihyperbolic and nonhyperbolic attractors in the Lorenz system, re- 
spectively. As seen, for the quasihyperbolic Lorenz attractor the angles are 
bounded away from 0, while for the nonhyperbolic attractor the probability 
of close to zero angle values is larger than 0. We have also studied other 
3-dimensional flow systems with this approach. Figure 2(d) presents the an- 
gle distribution for the Rossler system [37,38] at a = 0.2, = 5.0, whose 

attractor is known to be a typical example of a nonhyperbolic attractor. Our 
numerical analysis exhibits clear evidence for this attractor type. 

3 Properties of Nonhyperbolic Attractors of Two- 

Dimensional Invertible Maps in the Presence of Noise 

As has been already mentioned, one of the peculiarities of nonhyperbolic 
chads is its nonrobustness to small perturbations of the system. Because of 
this, even when a system control parameter is varied over small intervals, a set 
of bifurcations is observed resulting in switchings between different chaotic 
and regular regimes. The dependence of a certain quantitative characteris- 
tic of the regime on the control parameter is found to be a strongly rugged 
non-smooth function. To illustrate this we compute the largest Lyapunov 



(a) (b) 





Fig. 3. Largest Lyapunov exponent for the Henon map versus the control parameter 
a for 6 = 0.3 without noise (a) Eind in the presence of noise with D = 0.005 (b) 
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exponent A for the Henon map (1) and (3) as a function of the control pa- 
rameter a. The results are shown in Fig. 3. It is seen that on a rather small 
parameter range, we can find regions with negative Lyapunov exponent val- 
ues, which correspond to windows of stability of periodic regimes. However, 
the introduction of noise perturbations to the system can smooth the depen- 
dence by eliminating the most narrow periodic windows (see Fig. 3(b)). With 
further increase of the noise intensity the dependence A(o) is becoming more 
and more smooth and similar to that for quasihyperbolic chaos. The measure 
P~ of regular regimes in the given parameter a range is shown in Fig. 4 as 
a function of the noise intensity D. To quantify P~ we sum the lengths of 
all intervals corresponding to regular regimes and then calculate the ratio of 
this sum to the total length of the considered range of parameter a variation. 




Fig. 4. For the Henon map (6 = 0.3), the measure P of regular regimes in the 
parameter a range [1.3, 1.8] is depicted as a function of the noise intensity D 

It is evident that other averaged over the attractor characteristics behave 
in a similar manner. Therefore, although noise perturbations do not influence 
the angle distribution, i.e. they do not change the nonhyperbolic character 
of the attractor, the noise may significantly affect its characteristics. As a 
result, a nonhyperbolic attractor becomes more similar in its properties to a 
hyperbolic one. Thus, one may assume that for bounded noise of sufficient 
intensity a nonhyperbolic attractor can be appropriately characterized by a 
stationary invariant probability measure. 



4 Exploration of the Probability Distribution 
on Nonhyperbolic Attractors in the Presence 
of Bounded Noise 



In this section we consider the statisticcil characteristics of evolutionary pro- 
cesses which are described by nonlinear discrete invertible maps / with ad- 
ditive noise: 






( 6 ) 
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In the stochastic equation (SE) (6) a:„ is a 2-dimensional vector of the system 
state, / is a nonlinear deterministic function defining a map, is bounded 
noise, and D denotes the matrix of noise intensities. 

There are two methods for calculating the probability distribution. First 
we compute a chaotic sequence x„ by iterating stochastic equations (6) n = 
10® times from a set of different initial conditions a:(0) and for some given 
noise intensities D. Then we estimate the probability measure P^ihj) using 
normalized residence times of the trajectory in a square element {i,j) on the 
phase plane. The process is assumed to he ergodic. 

The second method for finding the distribution is based on the evolution 
equation for the probability density. If one takes into account that random 
perturbations are statistically independent in sequential time moments, then 
the process = a:(ri) is Markovian. In this case the probability density of 
quantity obeys the following evolution equation [39]: 






i^n+l) — I 
Jw 



\detD{xn)\ 



Pa: 



( 7 ) 



where p^ is the probability density of noise, £>~Ms the matrix inverse to the 
matrix of noise intensities. The integral is taken over all possible Xn values. 
Setting initial probability density p®(xo) and implementing successively the 
transformation (7), one can see how the probability density of the process 
Xn evolves in time. Our calculations have shown that to find the stationary 
probability density by solving the integral equation (7), the number of time 
steps 100 <n < 140 is quite sufficient. But in practice this procedure requires 
a significant computer time which is hundreds times as much as that one 
necessary for calculating the distribution via the SE method. 

We begin our numerical experiments by considering again the Henon map 
(3) with o = 1.06, b = 0.3. For these parameter values, a nonhyperbolic at- 
tractor is realized consisting of four parts, also called bands. The presence 
of additive noise leads to connected bifurcations, i.e., the attractor bands 
merge. For example, for the noise intensity D = 0.05, there already exists a 
two-band attractor. With increasing noise intensity, another connected bifur- 
cation takes place resulting in the merging of two attractor bands. Thus, the 
noise eliminates the periodic non-stationarity of the process, and a merged 
1-band attractor is realized in the map. Setting the noise intensity D — 0.28, 
we solve numerically stochastic equations (3) and the corresponding evo- 
lution equation for the probability density and afterwards, construct the 
probability distribution Pxy{i,j)- The results are shown in Figs. 5(a) and 
5(b). Pxy{i,j) denotes the probability of finding a representative point in 
a small covering box of edge length e centered at the point {xi,yj). In the 
computation, the value of e does not exceed 10“® that allows one to con- 
sider Pxy{i,j) = £^Pxy{xi,yj), where Pxy{xi,yj) is the probability density. 
As follows from the obtained results, in a time n > 100 the time-invariant 
probability distribution is established on the merged chaotic attractor of the 
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(c) (d) 





Fig. 5. Statistical characteristics of the map (3) for a = 1.06, b = 0.3, D = 0.28. (a) 
The stationary probability distribution calculated from (7); (b) the time-averaged 
distribution obtained from SE; (c) the average square of the difference between the 
distributions versus n; (d) the dependence of the variance, derived from distribu- 
tion Pxy{i,j, n), on n values (the dashed line denotes the variance calculated using 

P.ViJ)) 

Henon map. Our numerical experiments have shown that the probability 
distribution does not depend on the choice of initial distribution. Compar- 
ing Figs. 5(a) and 5(b) it can be seen that the distribution, obtained from 
a single time series of the SE (3), is the same as that one computed from 
the evolution equation. Our calculations have shown that for n > 120 both 
distributions coincide within a round-off error. 

Now we briefly discuss the convergence rate of the methods for calculating 
the probability distribution. For this purpose we first compute the square 
of the difference (Pxy(i,j,n) — Pxy{i,j)Y = averaged over all partition 
elements n is the calculation time for P^y. The results are shown in 
Fig. 5(c). We have also estimated the variance of the quantity Xn from the 
distribution Pxy{i,j,n). The dependence of on n is plotted in Fig. 5(d). 
The variance converges to a certain constant value with n, which corresponds 
to the variance computed from P*y(i,j). Thus, as follows from Figs. 5(c) 
and 5(d), both methods for calculating the probability distribution are in 
very good agreement with each other. The obtained results indicate that 
the methods of SE and of the evolution equation for the probability density 
are also equivalent for the typical nonhyperbolic system (3) at least starting 
from a certain noise intensity D. This statement has been verified by the 
computations performed for another 2-dimensional maps. We studied, for 
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example, the cubic map with two co-existing nonhyperbolic chaotic attractors 
which merge in the presence of noise. 

5 Conclusions 

In this paper we have studied the peculiarities of nonhyperbolic chaotic at- 
tractors. To reliably distinguish hyperbolic and nonhyperbolic attractors we 
applied a numerical procedure based on the calculation of angles between 
the stable and unstable directions along a chaotic trajectory of the chaotic 
set. The efficiency of this method has been demonstrated using some 2-dim 
maps and 3-dim differential systems. Our studies have shown that the calcu- 
lation of angles can serve as an efficient characteristic for exploring the type 
and structure of chaotic attractor. Numerical results have also shown that 
the presence of additive noise sources does not affect the structure of an- 
gle probability distributions for both the quasihyperbolic and nonhyperbolic 
attractors. This approach also enables to calculate the borderline between 
quasihyperbolic and nonhyperbolic attractors. 

We have also discussed the effect of bounded noise on the statistical prop- 
erties of nonhyperbolic chaotic attractors. We have found that in the presence 
of noise of relatively high intensity nonhyperbolic noisy attractors can possess 
a steady stationary probability density being invariant to the choice of initial 
density. In this case noisy nonhyperbolic attractors can be characterized by 
the properties being typical for hyperbolic and almost hyperbolic attractors. 
We have shown that the method of stochastic equations is an appropriate 
and more fast way for calculating the steady probability density on nonhy- 
perbblic noisy attractors. The analysis of 2-dim invertible maps allows one to 
conclude that the SE method can be used for finding the steady probability 
measure on chaotic attractors of nonhyperbolic 3-dim flow systems. 

We are grateful to Prof. W. Ebeling and Dr. A. Neiman for fruitful discus- 
sions and useful comments. G. S. acknowledges support from INTAS (grant 
No. 97-574). V.A. acknowledges support from Humboldt Foundation through 
the Humboldt Research Award. 
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Abstract. In the theory of communication two definitions of the concept “informa- 
tion” are known. One of them coincides according to its form with the Boltzmann 
entropy. The second definition of information is the difference between uncondi- 
tional and conditional entropies. In the present work this latter is used for the 
definition of the information about states of open systems with various meanings 
of the control parameter. 

Two kinds of open systems are considered. The first class of systems concerns 
those which with zero value of the control parameter are in an equilibrium state. 
The information on an equilibrium state is equal to zero. During self-organizing in 
the process of departing from an equilibrium state the information increases. For 
open systems of this class the conservation law for the sum of the information and 
entropy with all values of control parameter is proved. 

In open systems of the second class the equilibrium condition is impossible. For 
them the concept “norm of a chaoticity” is introduced. It allows to consider two 
kinds of processes of self-organization and to give the corresponding definitions of 
information. The statement is carried out on a number of (classical and quantum) 
examples of physical systems. The example of a medico-biological system also is 
considered. 



1 Introduction 

The aim of this paper is to consider the new subject “Information of open 
systems” . In the theory of communications two definitions of the information 
are used. Both of them were introduced in the work by C. Shannon [1]. For 
one of them, the expression for the information coincides with the formula 
for Boltzmann entropy. For this reason it is called S-information. Besides it 
another dehnition is used. The second definition of information was aiso of- 
fered by C. Shannon [1~3]. The information there is defined as a difference 
between unconditional and conditional entropies. In both cases the informa- 
tion is connected with entropy, which serves as the best measure of the degree 
of uncertainty in the statistical description of macroscopic systems. 

Entropy and information can also play other roles, when we talk about 
open systems. In particular, entropy can play the role of relative degree of 
order (or chaos) of states for open systems. The corresponding the new role 
play and the information. Now we can answer the question: What does it 
mean “Physics of open systems?” 



J.A. Freund and T. Poschel (Eds.): LNP 557, pp. 422-433, 2000. 
(c) Springer- Verlag Berlin Heidelberg 2000 
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2 Information of Open Systems 

Open systems can exchange energy, matter, and (last but not least) informa- 
tion with the environment. We shall consider only open macroscopic systems. 
They are composed of many objects, constituent structural elements of dif- 
ferent nature. 

Due to the complexity of open systems, they may demonstrate a variety 
of structures. Dissipation plays a constructive role in the formation of these 
structures. To emphasize this, Prigogine has introduced the term “dissipa- 
tive structures’’ [4-6]. This comprehensive and exact term covers all sorts of 
structures: temporal, spatial and temporal-spatial structures. The latter are 
exemplified by autowaves. 

The complexity of open systems provides an ample opportunity for co- 
operative phenomena to occur. In order to emphasize the role of collective 
interactions in the formation of dissipative structures, Haken has introduced 
the term “synergetics”, that means joint action [7-10]. 

All systems considered here are macroscopic. This means that they con- 
sist of a large number of elements. This allows ns in many cases to treat such 
systems as a continuous medium. Such convention changes dramatically the 
nature of the system. In order to avoid the potential problems, it is neces- 
sary to use a physical definition of continuous medium rather than a formal 
mathematical definition. This requires a concrete definition of physically in- 
finitesimal time and length scales in terms of characteristic parameters of the 
system. The corresponding physically infinitesimal volume is the equivalent 
to a physical “point” [11, 12]. 

The brief list of main concepts of physics of open systems shows that the 
absence of a sharp and clear definition of the concept “information” for states 
of open systems is one of the gaps of this theory. The wiping out of this gap 
is the main purpose for the present article. 

3 Entropy and Information 

3.1 Boltzmann Information (S'-Information) 

There are two statistical definitions for information. The first one coincides by 
form with Boltzmann’s definition of entropy. If f{X) is any dimensionless dis- 
tribution function of dimensionless variable X, then the Boltzmann’s entropy 
and information (“5- information”) is defined by expression [1,9, 13, 18] 

I[X] = 5[A] = - 1 f{X) In f{X)dX. (1) 

The corresponding definition for discrete variables is 

I[n] - 5[n] = - ^ ln/„. (2) 
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In the book [13] and in [14] (ses also the book [15]) there are arguments 
for the existence of the conservation law for information and entropy 

I[X] + 5[X] = const. (3) 

This statement, however, is in contradiction with definition of S-information. 



3.2 Shannon Information 

To define the change of information in processes in open systems it is more 
effective to use a more general definition of information [1-3] 

I[X\Y] = 5[X] - 5[Y|Y]. (4) 

Here 5[X] is ordinary Boltzmann - Shannon entropy 

S[X] = - j f{X)\nf{X)dX (5) 

and 5[X|y] the conditional entropy. The latter is connected with the condi- 
tional distribution function /[X|Y] {f{X,Y) = f[X\Y]f{Y)) 

S[X\Y] = - I f (X,Y) In f{X\Y)dXdY. (6) 

The expression (5) can be presented in more symmetrical form 

I[X\Y] = I In Y)dXdY > 0. (7) 

The information is valid only for statistically independent quantities X, Y. 
Let the distribution function be defined by the first moment completely. 

f{Y)=S(Y-a). (8) 

a is any characteristic parameter. In open systems it can play the role of 
control (governing or rule) parameter. After integrating in (6), (7) over Y we 
will obtain the following expression for the information 

I[X\a] = 5[A] - S[X\a] = 5[X] -I- J f{X\a)\nf{X\a)dX. (9) 

It is necessary to remark that such expression for information is not posi- 
tive in all cases. To ensure the positiveness of this expression the correspond- 
ing additional conditions must be used. 

Thus it is necessary to establish the conditions at which the information 
J[X|a] > 0. We shall do this for concrete examples. 
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4 Boltzmann’s if-Theorem 



4.1 Lyapunov Functional 4s 



The name of iJ-theorem (where H stand for “heat”) was introduced by the 
British physicist called Burbury in 1894, several years after Ludwig Boltz- 
mann had proved this statement. 

Textbooks on molecular and statistical physics maintain that Boltzmann’s 
iL-theorem holds for closed systems. This statement needs a certain refine- 
ment which will be very important for the formulation of criteria of self- 
organization “S-theorem” . 

Boltzmann’s Lf-theorem states that the entropy of a closed system in- 
creases in the course of the evolution to the equilibrium state, and remains 
constant in the state of equilibrium: 



dt 



> 0. 



(10) 



It is important, however, that the mean energy of rarefied Boltzmann gas 
remains constant in the course of evolution to the equilibrium state: 



Hence, the quantity which is conserved is not the energy E, but the mean 
energy (E ) , therefore the fluctuations of energy are allowed. This shows that 
there exists the internal non-closedness of the Boltzmann gas system, which 
is due to the existence of an infinite (in the thermodynamic limit) buffer 
of internal degree of freedom. Boltzmann’s kinetic equation only contains a 
small fraction of total information about the system. 

The inclusion of condition (11) allows us to formulate Boltzmann’s H- 
theorem in terms of the functional 

( 12 ) 



= (13) 

The second inequality follows from the /f -theorem. 

These two inequalities show that As = Sq — S{t) is the Lyapunov func- 
tional [11, 12]. 



4.2 Information and Lyapunov Functional 4^. Conservation Law 
of Entropy and Information for Boltzmann Gas 



Let us return to the expression (9). 
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Let the values of the control parameter a be positive and the noncondi- 
tional entropy 5[X] correspond to the zero value of the control parameter 

a>0 and 5[X] = 5[X|a = 0], (14) 

therefore the information 



7[X|a = 0] = 0. (15) 

So, the nonconditional entropy 5[X] corresponds to the equilibrium state. 

We can use the expression (9) for the Boltzmann gas. In this case time t 
can play the role of the control parameter with 0 < t < oo. The value t = oo 
corresponds to the equilibrium state. Then the information will be defined 
by the expression 



I[r,p,t] = As = So - S{t) = 



ks 




f{r,P,t} 

foir.p) 






dr dp 
(27rh)^ 



> 0. 



(16) 



We see that in the course of the time evolution to the equilibrium state 
the conservation law for the sum of information and entropy H applies 



I[r,p\t] + S{t) = So = const. (17) 

The constant is defined by the equilibrium value of entropy. For the equilib- 
rium state the information and the Lyapunov functional are equal the zero 

7[r,p|f = oo] = T 5 (t = oo) = 0. (18) 

Thus for the Boltzman gas the positiveness of information is the natural 
property of this system. To ensure the fulfillment of the condition 7[X|a] > 0 
in a general case the additional constancy condition for all values of control 
parameter must be used. 



5 5-Theorem and Conservation Law of Information 
and Entropy 

5.1 5^-Theorem - Criterion for the Relative Degree of Order 

Among all thermodynamic functions, only the entropy S possesses a com- 
bination of properties that allow it to be used as a measure of uncertainty 
(chaoticity) in the statistical description of processes in macroscopic systems. 

To use this possibility it is necessary to redefine entropy so that the av- 
erage energy remains constant in the course of evolution. 

We shall consider for simple illustration the evolution of stationary states 
in the Van der Pol oscillator at different values of the feedback parameter a. 
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For this system the criterion of a relative degree of chaoticity was formulated 
for the first time in [15,16] and called the “5-theorem”. 

Assume the existence of two states with the feedback parameter a = 0 
(the equilibrium state) and a = ai . 

Let us denote the macroscopic characteristic of the stationary state as X. 
The role of X for an oscillator can be played by the oscillation energy E. 
Let us further denote the distribution functions of two distinguished states 
as foji and the corresponding entropy values as 5 q, 5i. 

The renormalization to the given value of mean energy is carried out by 
substituting temperature T by the new value T. The new temperature is 
determined from the solution of the equation (X — t E) 

kef^ J Efo{E,a = 0)dE = j Efi{E,a = ai)dE. (19) 

For the system under consideration the solution of this equation has the form: 

f(a) > T. (20) 

The sign of equality is relevant at a = ao = 0, i.e. for the equilibrium state. 

Evidently, the state “0” should be “heated” to equalize average energies. 
As the comparison is now made at identical values of the average effective 
energy, the entropy difference 5o, 5i can serve as a measure of the relative 
degree of order in the distinguished states: 

5o - 5i = I (^In (E)dE > 0. (21) 



on the condition that 

{E) ■= const. (22) 

The result of computing the relative degree of order in the two distin- 
guished states is represented by two inequalities. One of them (20) confirms 
the correct choice of the “0” state as more chaotic. The formula (21) provides 
a quantitative measure of the relative degree of order in the distinguished 
states. 

Using the general formula (9) we can define the information I{E) for the 
state of oscillation 



I{E) = So -S, = I (in h{E)dE > 0. (23) 

We see that the information is the zero for the equilibrium state, when the 
value of the feedback parameter equals zero. 

It is possible to use the criterion “5-theorem” to estimate the relative 
degree of order for the transition from laminar to turbulent flow [16]. 
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5.2 Estimation of Information and of the Relative Degree 
of Order from Experimental Data 

The practical application of the 5-theorem implies that the effective Hamilton 
function is known. In many cases, however, there are no adequate mathemat- 
ical models for open physical systems. This problem is even more complicated 
as far as biological, social, and economic entities are concerned. 

Therefore, it is sometimes necessary to be able to determine the relative 
degree of order in open systems directly from experimental data. This can be 
achieved in the following way: 

1. By selecting control parameters for a given system, e.g. two states of 
the system with control parameters ao and oq -I- Aa. 

2. By experimentally obtaining sufficiently long temporal realizations for 
the chosen values of the governing parameters. 

JC(t,ao -h Aa). (24) 

These data are loaded into a computer and used to construct the correspond- 
ing distribution functions: 

fo{X,ao), f{X,ao + Aa). (25) 

The two distributions are normalized to unity. 

Further operations are as above. 



5.3 Diagnosis of Medico-biological Objects 

Let us consider some applications of the 5-theorem for the purpose of medico- 
biological diagnostics. Investigations into this problem were initiated in Kiev 
and Moscow in 1990, using both mathematical models and experimental data. 
In 1994, the first results of the analysis of cardiograms based on the 5-theorem 
were obtained by the joint efforts of biologists and clinicians in the Labora- 
tories of Nonlinear Dynamics at the Saratov and Potsdam Universities (see 
in [10,17]). 

Biological experiments reported by T. G. Anishchenko from Saratov uni- 
versity revealed significant differences in the responsiveness of male and fe- 
male rats to the noise stress. Biochemical studies have demonstrated opposite 
changes in the behavior of the two sexes. This finding provided the basis for 
a study of men and women’s behavior in response to stress. The evaluation 
was also made using the 5-theorem. 

Two cardiograms were obtained from each subject included in the study, 
one before and the other after identical stress impact (a shrilly acoustic sig- 
nal). 

Two cardiograms being available from each subject, this allowed a change 
in the relative degree of order to be individually estimated using the 5- 
theorem. The experiment has demonstrated opposite changes in the degree 
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of order in men and women, the former showing a decreased degree of chaos, 
while in the latter it increased. 

In both cases, there was a deviation from the “norm of chaos” suggesting 
“pathology”. It is for physicians to decide which “disease” is more dangerous. 

The return to the “norm of chaos” may be spontaneous. Then, the “re- 
covery” occurs unaided, with time serving as the control parameter. If the 
patient’s conditions are normalized by drug therapy, its efficacy is possible 
to evaluate using the same criterion. 

The investigation of cardiograms before and after stress gives a possibility 
to find the corresponding change of information. Return for this to the general 
formula (9). 

Mark by Iw and Im the renormalized information is obtained on women’s 
and men’s cardiograms, correspondingly. From the experiments described 
follows that for women the more chaotic state is the state after stress. By 
contrast for men more chaotic is the state before stress - in the normal state. 

Therefore, for women renormalized entropy for the state 

after stress, and is the renormalized entropy for normal state - the 

state before the stress. With taking into account this definitions we obtain 
the following two definitions of information 



Iw = 



q(W) 

‘^after 



-s, 



(W) 

before 



> 0 ; 



Im 



qiM) _ q(M) 

^before ^afier 



> 0 . 



(26) 



We see that for women as a result of stress the quantity of information 
obtained by cardiogram increases. By contrast, for men the corresponding 
information after stress decreases. 



6 What Is Self-Organization? 

6.1 Start from Equilibrium 

Two classes of systems were outlined in a previous Section. 

One of them includes many physical systems exemplified in the forego- 
ing discussion by two cases. To begin with, it is a Van der Pol oscillator 
in which losses (of electrical resistance) are first compensated as the feed- 
back parameter grows while its further rise results in the transition to the 
developed oscillation region. According to the 5-theorem, this is a case of 
self-organization. This process starts from the equilibrium, as only thermal 
fluctuations are there in an electrical circuit in the absence of feedback. This 
leads to the conclusion that the process of self-organization may be defined 
as the transition from a most chaotic (equilibrium) state to a more ordered 
one (oscillation). 

The situation is similar in the transition from laminar to turbulent flow in 
a pipe with increasing pressure difference (a higher Reynolds number) [3, 16]. 
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Here, the reference point for the degree of chaos is also the equilibrium 
state of a fluid in the absence of pressure difference, that is at the zero control 
parameter. In this case, hydrodynamic motion is lacking and only chaotic 
motion of molecules occurs. Evidently, this state is most chaotic. 

Again, the process of self-organization is the transition from a more chaotic 
to a less chaotic state. Is this the universal definition of self-organization? It 
can be inferred from the previous section that the process of self-organization 
is not necessarily associated with an increase in the degree of order. 

Indeed, there is a broad class of systems (in the first place, biological 
systems) for which neither the state of complete chaos (thermodynamic equi- 
librium) nor that of ideal order can be realized. Biological systems would not 
function under such conditions. 

A more fundamental notion for such systems is the “norm of chaos” which 
has been used more than once in the previous discussion. This notion is 
compatible with that of “health”. Then, self-organization is the process of 
recovery [3, 17]. 

Now, let us turn back to the studies on the responsiveness of men and 
women to stress. Earlier, we have agreed to regard post-stress conditions 
as “pathology”. This means that the transitions to the “norm of chaos” in 
women is actually the “recovery” referred to above as self-organization, i.e. 
the transition from a more chaotic to less chaotic state. 

Conversely, the stress-induced state for men is “illness” which corresponds 
to a more ordered state. 

Hence, the “recovery” (self-organization) for men is the transition from 
an ordered state to a more chaotic one. 

Thus the concepts of self-organization and degradation in biological sys- 
tems cannot be unequivocally related to an enhanced (self-organization) or 
impaired (degradation) degree of order respectively. 

A more fundamental notion for such systems is the “norm of chaos” which 
can be estimated from empirical data using the “5-theorem” criterion [3, 17]. 

To summarize, it appears from the above analysis that in certain cases self- 
organization is easy to observe, e.g. the generation developing in a Van der Pol 
system with an increasing feedback parameter. Other well-known examples 
are the appearance of a new structure (Benard cells) at the liquid surface 
heated from below and Taylor vortices between rotating coaxial cylinders. 
Using the most fortunate term “dissipative structures” coined by Prigogine 
[14-16], the self-organization process may be described as the spontaneous 
occurrence of structures in nonlinear dissipative open systems, e.g. temporal 
dissipative structures in the Van der Pol generator and spatial dissipative 
structures exemplified by the Benard cells and Taylor vortices. Elimination 
of the control parameter (feedback, temperature gradient, etc.) in all these 
cases results in a “system at rest”, i.e. one in the state of thermodynamic 
equilibrium. 
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Such understanding of the term “self-organization” underlies the theory 
of formation of dissipative structures. The first systematic exposition of this 
range of problems has been given in the well-known book of G. Nicolis and 
I. Prigogin. The starting point was Prigogine’s ideas on thermodynamics of 
irreversible nonequilibrium processes. 

Haken’s theory of self-organization is based on the appearance of struc- 
tures due to collective interactions [7, 8]. In other words, cooperative processes 
are posited as being of primary importance. This prompted Haken to use the 
term “synergetics” for this new interdisciplinary field of research. 



6.2 Norm of Chaoticity. Two Kinds of Self-Organization 

In more complicated cases such as transition from one turbulent motion to 
another, in biological systems, it is possible to distinguish between the pro- 
cesses of degradation and self-organization based on the “^-theorem” crite- 
rion. In such cases, the understanding of self-organization as the appearance 
of new structures or the transition from less to more ordered states becomes 
insufficient. 

This inference is valid for all systems in which the equilibrium state can 
not serve as the reference point for the relative degree of chaos (or order). 
Here, the “norm of chaos” concept is of greater importance and, in the general 
case, certainly applies to the nonequilibrium state, with the transition from 
“pathology” to “health” corresponding to self-organization. Since deviation 
from the norm is possible in two directions (towards a greater or smaller 
degree of chaos), the self-organization process may in the general case also 
proceed in two directions [12,17]. 

Therefore, the traditional definition of self-organization as the sponta- 
neous formation of structures in dyncimic nonlinear dissipative open systems 
is too “narrow” . A more comprehensive description of self-organization pro- 
cesses, even their mere identification, is feasible by the methods of the sta- 
tistical theory of open systems. 

The term “self-organization” is actually rooted deep in ancient thought. 
This is a very interesting question worthy of illustration by the following 
facts. 

In 1966, the book on “Principles of Self-Organization” was published in 
the Russian language. It is a collection of reports delivered to a Symposium 
at the Illinois State University, USA, in 1961. Here is a quotation from the 
Preface to the Russian edition by A Lerner, the editor: 

“Despite the marked prevalence of self-organizing systems and persistent 
attempts of scientists to understand the phenomena occurring in such sys- 
tems, self-organization has in a way remained for many centuries perhaps the 
most mysterious phenomenon, the most intimate of nature’s secrets”. The 
Preface goes on to state: “... the reader will hardly find here a report which 
would not claim to disclose the mystery of self-organization” . 




432 



Yu. L. Klimontovich 



Heinz von Foerster, the editor of the American publication, writes in the 
Introduction with reference to a story by Plato, a famous Greek philosopher: 

“The house of Agathon was the place where the first memorable sympo- 
sium was held on the problems lying at the junction of different sciences, at- 
tended by philosophers, statesmen, dramatists, poets, sociologists, linguists, 
doctors and students learning various trades” . 

The report by Y. Eshby, a known expert in the field, contains a statement 
to the effect that the word “self-organization” can also mean “transition from 
bad to good organization” , even though the author does not explain how to 
distinguish between “bad” and “good”. An approach to this problem is il- 
lustrated by the above-mentioned analysis of cardiograms which allowed to 
differentiate between “health” and “pathology”. Such a distinction is also 
possible based on the above criterion for the relative degree of chaos in dif- 
ferent states of open systems. 

Naturally, there are more diagnostic criteria to evaluate the state of bi- 
ological systems. However, the comparison of different diagnostic tools is a 
matter which requires special attention. 

6.3 Information in Processes of Self-Organization 

Thus we divided the open systems into two classes. For the first ones for 
self-organization’s processes exists the most chaotic starting point - the equi- 
librium state. For such systems the self-organization process may be defined 
as the spontaneous occurrence of structures in nonlinear dissipative open sys- 
tems in course from the equilibrium states. In these cases the further one gets 
from the equilibrium states the information increases. 

However we saw that, as example, for biological systems the understand- 
ing of self-organization as the appearance of new structures or the transition 
from less to more ordered states becomes insufficient. Here, the “norm of 
chaos” concept is of greater importance and, in the general case, certainly 
applies to the nonequilibrium state, with the transition from “pathology” to 
“health” corresponding to self-organization. Since deviation from the norm 
is possible in two directions - towards a greater or smaller degree of chaos, the 
self-organization process may in the general case also proceed in two direc- 
tions. 

As consequence for such systems there exist two roots for the appearance 
of information. In the process of recover for women (from “after” to “before”) 
when the process goes from more chaotic to less chaotic state - to norm of 
chaoticity, the information is obtained by cardiogram increases. Opposite, for 
men the information in the process of self-organization decreases. 

7 Conclusion 

The role of entropy and information, as we have seen, increases considerably 
when we come to the problem of the relative order for states of open systems. 
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It is possible to show that entropy can play also another role, acting as 

measure of diversity of state of open systems for natural selection, which, 

according to Darwin, is the heart of biological evolution. A simple illustration 

was done in [11]. There the local entropy is a measure of diversity. 
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Nonlinear Spatiotemporal Patterns in Globally 
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Abstract. Global couplings strongly affect structure formation in spatially ex- 
tended nonlinear dynamic systems. We review the role of such global constraints 
on spatiotemporal patterns in reaction-diffusion systems of activator-inhibitor type. 
Important applications pertain to current filaments and fronts in semiconductors 
where global couplings are naturally introduced by the resistive circuit environment 
in which semiconductor devices are generally operated. 



1 Active Media 



A nonlinear spatially extended dynamic system can often be described as 
an active medium [1], This concept has been successfully applied to a vari- 
ety of dissipative systems in physics, chemistry, and even biology and ecology. 
Although the microscopic mechanisms are different, the macroscopic phenom- 
ena of self-organized pattern formation show many common features [2,3]. 
A particularly interesting model system is provided by semiconductors [4, 5]. 
These are dissipative dynamic systems due to the dissipation of electrical 
energy in charge transport. They are nonlinear due to the inherent nonlin- 
earities in the charge transport processes at high fields. From these properties 
various spatial, temporal and spatiotemporal patterns are expected in semi- 
conductors [6-1 Ij. 

An important feature of active media is the activator-inhibitor principle. 
An activator-inhibitor system is most simply modelled as a system of two 
nonlinear reaction-diffusion equations 






( 1 ) 

( 2 ) 



where a and u denote the local activator and inhibitor, respectively, Ta,Tu 
are time scales, I, L are characteristic diffusion lengths, and / and g are 
appropriate functions of a and u. The production of the inhibitor u increases 
with activator concentration a and saturates with increasing u. The activator 
a is increased by autocatalytic reproduction, and is inhibited by u. In the 
generic case, f{a,u) is a non-monotonic function of a, increasing in a certain 
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interval of a, and decreasing with u, while g may in the simplest case be of 
the form g = a — u. Depending on the intersection between the null-clines 
f{a,u) = 0 and g{a,u) = 0, either bistable, excitable, or oscillatory (Turing- 
Hopf) behaviour is found. 

A description of transport in terms of a simple reaction-diffusion model 
is possible for various semiconductor structures like pnpn-diodes, pm-diodes, 
heterostructure hot electron diodes, double barrier resonant tunneling struc- 
tures, or other layered structures, albeit some semiconductor systems may re- 
quire refined modelling in terms of more sophisticated transport models [12] . 

In many cases in addition to a local diffusive coupling spatially extended 
nonlinear systems also experience a global coupling. Generally, global coupling 
is related to external constraints imposed upon the system’s dynamics. In the 
presence of global coupling, some dynamic variables of the active media (e.g., 
the global excitation level) depend on the spatially averaged parameters of 
the self-organized pattern which the system exhibits. Global coupling has 
been recognized as an important factor for spatiotemporal dynamics in spa- 
tially extended systems [13,14]. For instance, in chemical surface reactions, 
the pressure of the gas phase, which is the same over the whole surface, rep- 
resents such a global constraint. In thermokinetic reactions on surfaces with 
a large heat conductivity the temperature becomes a global parameter which 
depends on the size of the surface where the reaction takes place and where 
heat is produced or absorbed. In optically bistable systems the absorption 
coefficient may depend on the density of the excited particles and, hence, the 
intensity of the penetrating light becomes a function of the depth to which 
the excited pattern extends into the bistable element. 

In the context of semiconductor transport, global coupling arises naturally 
for spatially inhomogeneous current densities j(x,t), e.g., current filaments, 
due to the operation in a load circuit. In bistable semiconductor systems the 
global coupling represents an inherent feature of spatiotemporal dynamics of 
the current density patterns (e.g., current filaments, fronts, and pulses). The 
mechanism of this coupling is as follows: For any evolution of the current den- 
sity pattern which is accompanied by variation of the total current I through 
the device, the voltage drop at an external load or an internal series resis- 
tance i? changes. That causes a variation of the voltage u dropping across the 
device which usually characterizes the global excitation level of the bistable 
semiconductor system. This type of feedback is well known with respect to 
stationary [4, 15-17], breathing [18, 19], and spiking [20, 21] current filaments. 

In the following we consider this important case in some more detail. The 
voltage u across the sample is not fixed if the device is operated in a circuit 
as shown in Fig. 1. The capacitance C parallel to the sample is given by the 
sum of the device capacitance, the external capacitance and parasitic wire 
capacitances. Kirchhoff’s laws lead to 

du{t) 1 fUo — u 
dt ^ C V R 




( 3 ) 




Spatiotemporal patterns in globally coupled reaction-diffusion systems 439 



1 — Element — | 


/ 

1 

\ 


J = 
' / 


"C ^ 

— T5n— 








1 K 1 



Fig. 1. The bistable semiconductor element operated in a circuit with load resistor 
R and capacitor C, and applied bias voltage Uo- 



If the current density j is constant in the direction of transport (which defines 
the z-axis), the current through the device I is simply given by the integral 
over the cross-section A of the current flow 

/ = / dxdyj{a{x,y),u). (4) 

JA 

The arguments of j indicate that the local current density in a cross-section 
of the device depends not only on the voltage drop u but also on an additional 
internal local variable a{x,y) which distinguishes, e.g., different states of a 
bistable current density - field characteristic corresponding to the same volt- 
age. In an activator-inhibitor system a corresponds to the activator variable, 
and u represents the inhibitor. 

Under steady state conditions Eq. (3) reduces to / = {Uq - u) /R which 
defines the dc load line in the (I, u) plane. The stationary operating point of 
the system is determined by the intersection of the load line with the device 
characteristic I(u). 

Equation (3) can be rewritten as 

du f 

Ty,— = Uo - u - R j dxdyj{a,u), r„ = i?C, (5) 

which is of the general form of a globally coupled inhibitor equation which 
replaces the locally coupled Eq. (2). 



2 Patterns in Globally Coupled Bistable Systems 



By way of example, let us discuss the prototype of a bistable system, which 
consists of a single reaction-diffusion equation for the variable a 



da 

dt 



= /(a ) + D 



d^a 
dx'^ ’ 



( 6 ) 



with diffusion constant D and a cubic nonlinearity (Fig. 2) 



f{a) = -q{a-ai){a — a){a-a 3 ) q>0 ai < a < a^. (7) 



This system has the stable fixed points ai, 03 , and the unstable fixed point 
02 = a. The profound analogy of this bistable nonequilibrium system with 
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phase transitions in equilibrium (e.g., the Van-der-Waals gas) was pointed 
out by Schldgl [22], The condition for spatial coexistence of the two stable 
phases a\ and az can be derived for a one-dimensional infinite spatial domain 
by multiplying Eq. (6) by dajdx and integrating over dx subject to the 
boundary conditions a(— oo) = ua, a(oo) = ci. In the steady state this yields, 
because of |^(±oo) = 0, 



J a\ 



f{a)da = 0 . 



( 8 ) 



This condition may be visualized as an equal areas rule which fixes d = ^ (03 — 
oi) since it requires that the two areas above and below the a-axis in Fig. 2 
must be equal. Thus it is analogous to Maxwell’s rule in thermodynamics; 
this is a typical feature of a first-order phase transition. 




Fig. 2. Bistable nonlinear kinetic function f{a) and corresponding spatial front 
profile a(r) (Schematic) 



If the equal areas rule is not satisfied, a front between the two locally 
stable phases ui and 03 propagates with constant velocity v either into phase 
ai {v > 0) or into phase 03 (u < 0) inducing a nonequilibrium phase transition 
to the respective absolutely stable phase. The front velocity v can be derived 
by the same argument as the equal areas rule above, assuming a self-similar 
spatial profile a{x,t) = ao{x — vt) satisfying the boundary conditions. In the 
co-moving frame ^ = x — vt {6) becomes 

•-$+/<“•)=«■ ra) 

Multiplying Eq. (9) by dao / d^ and integrating over d^ yields 




The direction of motion of the front is thus determined by the sign of the 
integral f{a)da, since the denominator is always positive. 

The above argument for phase coexistence with a flat interface can be 
extended to spherically symmetric ’’droplets” of phase az embedded in phase 
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Cl in d spatial dimensions. Such droplets can coexist with phase oi if their 
radius R is given by the critical radius 

dr / fj f{a)da • ( 11 ) 

It follows from the reaction-diffusion equation ( 6 ) in d dimensions (given 
spherical symmetry) with radial coordinate r 



da 

dt 



.. . T^d^a d — 1 da 



( 12 ) 



We assume that the droplet solution a(r, t) = ao(r-R{t)), where R{t) denotes 
the position of the interface dividing the two phases, satisfies the boundary 
conditions o(0,t) « a^, a(oo,t) = ai, |^(0, i) = 0. Transforming again to the 
co-moving frame ^ — r - R{t), Eq. (12) becomes 



Multiplying Eq. (13) by dao/d^ and integrating over yields 



^ = (d-l)D 



-L-L 

RO R 



(14) 



with ( 11 ), where we have used the approximation that ^ assumes essential 
values only around the interface at r « /i (Fig. 2). This dynamic equation 
describes the temporal evolution of the droplet radius i?(t); it contains the 
critical droplet radius as an unstable fixed point: larger droplets grow 
(.R > 0), while smaller ones decay {R <0). 

The droplet growth can be stabilized by imposing a global constraint 
-k{a) with A; > 0 as an additive term on the right hand side of Eq. (12) [13]. 
Hereby Eq. (14) is amended by replacing i£° with a time-dependent critical 
radius 



f°° dr 

RS) = id- l)^ .a 3 

Ja, f(a)da-k{a3-ai)a3V(t)/Vo 



(15) 



Here V(t)/Vo ~ R(t)'^ denotes the fraction of the spatial domain Vq which 
is occupied by the phase 03 , i.e., the droplet, and ai ss 0 has been used. 
The denominator in (15), which is analogous to the supersaturation of the 
vapour in thermodynamics, will decrease for a growing droplet. Accordingly, 
the critical radius increases as well. This is the typical behaviour of Ostwald 
ripening in a van-der-Waals gas. Here it is the effect of the inhibitory global 
interaction in a nonequilibrium system. It can be shown that now Eq. (14) 
for sufficiently large initial supersaturation Xq = f(a)da has a second 
fixed point Rq > R^, which is stable while i?° is still unstable. If now a 
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supercritical domain is formed {R > R^), it will grow only until it reaches 
the stable size Rq. If more than one droplet is present, the global interaction 
induces a competition (winner-takes-all dynamics) as a result of which only 
the initially largest droplet survives. 

This simple model has served to illustrate concepts and features of pattern 
formation in bistable nonequilibrium systems which are found in many of the 
more sophisticated models [5]. For the case d = 2 the above results apply 
to cylindrical current filaments in semiconductors. The stationary current 
density profile perpendicular to the current flow is similar to the one shown 
in Fig. 2. Periodic breathing and Ostwald ripening as a result of the circuit- 
induced global coupling can be described by dynamic equations of essentially 
the type (14) [13,18,19]. If the dielectric relaxation of the voltage u is fast 
according to Eq. (5), the inhibitor variable u can be eliminated adiabatically 
and substituted into (11), which introduces a time-dependent supersaturation 
analogous to (15). More detailed simulations of a microscopic model [23] have 
revealed similar winner-takes-all dynamics for the symmetry-breaking current 
filamentation in circular Corbino disks as shown in Fig. 3, in good agreement 
with experiments [24]: The initial radially symmetric front (a) breaks up 
into several streamers (b), each of which, after reaching the anode, forms 
a rudimentary filament (c). The pre-filaments then start growing in current 
while retaining approximately their original width (d). This leads to a rising 
total current I and thus, via the external load resistance, which acts as a 
global constraint due to Kirchhoff’s law Uo = u + RI, to a reduction in the 
sample voltage u. The pre-filaments therefore enter into a competition as a 
result of which only the filament which has first reached the outer contact 
survives (e). The other filaments slowly decay into the low-conducting state 
and vanish (f). This again furnishes an example of global coupling. 





Fig. 3. Simulation of the formation of a current filament in a Corbino disk. The 
temporal evolution of the current density |j(a;,j/)| is shown for a circular sample of 
diameter 2.1 mm and an inner contact diameter of 80 pm (Bias voltage Uo = 2 Y, 
load resistance R. = 10 kl?). (a) t = 0.2 ns, (b) t'= 0.8 ns, (c) t = 2.3 ns, (d) 
t = 4.0 ns (e) t = 8.0 ns (f) t = 20.0 ns. After [42]. 
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3 Accelerated, Decelerated, and Oscillatory Fronts 

If the coexistence condition between two stable fixed points, usually given in 
terms of an equal areas rule (8), is not satisfied, a front between the two phases 
propagates, as discussed in the previous section for a simple reaction-diffusion 
system. In this section we consider the propagation of a lateral current den- 
sity front in a bistable semiconductor with S- or Z-shaped current-voltage 
characteristics [25]. Such trigger fronts can switch a bistable system from 
one uniform steady state to another. An external load circuit introduces a 
global coupling which leads to positive or negative feedback upon the front 
dynamics in S- or Z-type systems, respectively. Double barrier resonant tun- 
neling diodes (DBRT) and heterostructure hot electron diodes (HHED) are 
used as examples of Z- and S-type systems, respectively, but similar results 
can be obtained for gate-driven thyristor structures, which also exhibit a Z- 
shaped current- voltage characteristic [26,27]. We shall point out similarities 
and differences between globally coupled dynamics of lateral current density 
patterns for these two major classes of bistable systems. 

Traveling front patterns in bistable and excitable active media [1] rep- 
resent a universal phenomenon which occurs in nonlinear spatially extended 
systems of different nature, ranging from physics [6, 28-32] and chemistry [33] 
to biology and ecology [32,34]. 

We consider one-dimensional fronts propagating along the x-axis in long, 
narrow samples, where the second transverse dimension Ly (along the y- 
axis) is so short that pattern formation cannot develop, and the longitudinal 
z-direction in which the current flows has been eliminated from the model 
equations. For a wide class of semiconductor systems the internal state can 
be characterized by a single variable a{x,t) which corresponds to the inter- 
nal degree of freedom relevant for the bistability. The reduced dynamical de- 
scription in terms of this variable can be derived from a full three-dimensional 
transport model, the Poisson equation and continuity equations via adiabatic 
elimination of fast variables as done, for instance, in [15, 20, 35-39] for various 
semiconductor systems. This equation takes the form of the reaction-diffusion 
equation (1). We assume passive (no-flux) boundaries described by von Neu- 
mann boundary conditions for a{x,t). The temporal dynamics of the voltage 
u{t) across the device is described by Kirchhoff’s equation for the external 
circuit (5) representing the global coupling. 

The local kinetic function f{a,u) is a non-monotonic function of a which 
for Uh < u < uth has three zeros oi < 02 < 03 reflecting the bistabil- 
ity. (Fig.2). For the homogeneous steady state, the local dependence a{u) 
is calculated from the null-isocline /(a, u) = 0 and inserted into j (a, u) in 
order to determine the local current density as a function of the voltage 
j{u) = j{a{u),u). Here we restrict ourselves to the case where the resulting 
current-voltage characteristic is S- or Z-shaped. We denote the current den- 
sity in the high conductivity and low conductivity states by Jo„ and Joff, 
respectively. The value 02 corresponds to the state on the intermediate branch 
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of the current-voltage characteristic. The higher value of a does not necessar- 
ily correspond to the higher value of the current density j and both situations 
(oi -4 Joff,az — > Jon) and (ai — > Jon, 0^3 — >• Joff) are possible in different 
systems. 

In the following we assume that t and x are measured in units of Ta and 
I, respectively, {t — >■ t/Ta, x — >■ x/l) and rewrite Eqs. (1),(5) as 



da 

dt 



f{a,u) + 



dJa 



(16) 



L, 

(joj 'T 1 /* 

£— = Uo-u-r{j{a,u)), £ = —, r = RL^Ly, (j) = -— jdx. (17) 

Tq Ijx J 

0 

We aim to describe the universal features of globally coupled dynamics of 
fronts in systems with S- and Z-shaped current-voltage characteristics which 
do not depend on the specific functions f{a,u) and j{a,u) used. For the 
HHED the internal variable a has the meaning of an interface charge density; 
the local kinetic function f{a,u) and the current density j{a,u) are given by 

XI — d 

f{a,u) = -Ta, j(a,u) = u-a , (18) 

These dependencies result in an S-shaped current-voltage characteristic as 
shown in Fig.4(c). For the DBRT the variable a is the electron concentration 
in the well. The local kinetic function /(a, u) and the local current density 
j{a,u) to be used in Eqs. (16), (17) are derived in [25]. The corresponding Z- 
shaped current- voltage characteristic is shown in Fig.4(d). For both models 
we use dimensionless variables throughout the paper. 

3.1 Voltage-Driven Front Dynamics 

Let us consider first the case of the voltage-driven circuit u — const. In this 
case a is the only dynamic variable, and the front between two stationary 
homogeneous states Jon{u) and Joff{u) propagates in a self-similar way with 
constant velocity v as described by (10): 

j{x,t) = jo{x - vt), jo Jon, Joff for x->-0,Lx- (19) 

Here u > 0 holds for hot fronts corresponding to the propagation of the high 
current density state into the low current density state, and n < 0 holds for 
cold fronts corresponding to the propagation of the low current density state 
into the high current density state. 

According to (10) the direction of the front propagation is determined by 
the sign of A{u) = f^^fia, u)da where ai and or correspond to left (a;=0) and 
right {x=Lx) boundary values, and should be chosen as ai or 03 accordingly: 
we have hot fronts with n > 0 for A(u) > 0 and cold fronts with u < 0 for 
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Fig. 4. Self-similar front propagation in the voltage-controlled regime u = const for 
S-shaped (a, c) and Z-shaped (b, d) bistability. The front velocity v is shown in (a, 
b) as a function of the applied voltage u. The phase flow in the {{j),u) plane for self- 
similar front propagation in the voltage-controlled regime is shown in (c, d). The 
thick solid line depicts the local current-voltage characteristic of uniform states. The 
thin solid line at u = Uco corresponds to a stationary front for !S> TT/, the thick 
dashed line corresponds to the stationary fronts for finite system size Lx a 5W/. 
The numerical parameters of the heterostructure hot electron diode (HHED) and 
the double barrier resonant tunneling structure (DBRT) are used in (a, c) and (b, 
d), respectively. After [25], 

A(u)<0. It can be readily seen that at the bifurcation points u = Uh and 
u = uth where two of the three fixed points coincide, the function f{a,u) has 
a fixed sign on the whole interval [01,03]. The sign of A{u) depends on which 
of the two states ai , 03 experiences the bifurcation but is always such that 
the “old” state propagates into the “new” state. Therefore for S-type systems 
we predict hot and cold fronts for u = Uh and u = uth, respectively, whereas 
for Z-type systems we expect cold and hot fronts for u = Uh and u = uth, 
respectively. For a certain value Uco between these points A{uco) = 0 and 
the front has zero velocity. Assuming monotonicity, we conclude that the 
u(u)-dependencies obtained for the HHED and DBRT by direct numerical 
simulations (Fig.4a,b) are qualitatively the same for all bistable systems with 
S- and Z-shaped characteristics. Note that these dependencies look similar 
but the direction of the front propagation is inverted. At u = Uh,uth the 
intermediate value 03 coincides with oi or 03, respectively, and the local 
kinetic function is tangent to the line / = 0 for o = 03 . The numerical 
simulations show that \dv/du\ = 00 at these points (see also [26]). 

In the ((j),n)-phase plane the trajectories corresponding to self-similar 
front propagation are represented by straight vertical arrows (Fig.4 (c,d)). 
The phase flow is directed up and down for hot and cold fronts, respectively. 
In a large system {Lx IF/, where VF/ is the front width) the line u = Uco 
exactly corresponds to stationary fronts, or kinks. In a finite-size system the 
branch of stationary kinks slightly deviates from the vertical line in such a 
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way that the sign of its differential conductance coincides with the differen- 
tial conductivity of the intermediate branch of uniform states, e.g., we have 
negative differential conductance (NDC) for S-shaped bistability and posi- 
tive differential conductance (PDC) for Z-shaped bistability (see Fig.4(c,d)). 
The deviation of the thick dashed curve from the vertical line at u = Uco 
reflects the attraction of the system boundaries in a finite-size system which 
causes a translation instability of a stationary front (first eigenvalue Ai > 0) 
in the voltage-controlled regime [17]. However, this instability can hardly be 
detected in numerical simulations even for > lOWf due to the pinning of 
fronts caused in this case by the discreteness of the grid. In realistic systems 
of large transverse dimensions the front stability in the voltage-driven regime 
is determined by structural imperfections rather than by boundary effects 
[17]. However, the sign of the differential conductance will be shown to have 
a crucial impact on the stability in presence of global coupling and will be 
discussed in detail in the following. 

3.2 Global Coupling via Passive External Circuit {R > 0) 

Qualitatively, the type of feedback on front dynamics is determined by the 
slope of the u(u)-dependence and the sign of the load resistance R in the 
external circuit. The propagation of hot fronts is accompanied by an increase 
of the total current and according to Eq. (5) for i? > 0 the voltage u decreases. 
Taking into account that dv/du > 0 for S-type systems and dv/du < 0 for Z- 
type systems (Fig.4(a,b)), we conclude that the front velocity decreases and 
increases, respectively. Similar reasoning holds for cold fronts. This results in 
negative feedback on front dynamics for S-type systems and positive feedback 
for 2-type systems. 

In Figs. 5 and 6, we present numerical solutions of Eq. (16), (17) for R > 
0 and sufficiently small s = Tu/to. Since in this case the relaxation of u 
is fast, the trajectories in the ((j),u)— plane adiabatically follow the load 
lines. The front propagation is decelerated for the S-system and accelerated 
for the Z-system. For the load line which intersects the line u = Uco the 
system possesses a fixed point corresponding to a stationary front at a certain 
position w = Wo (Figs. 5, 6, trajectories 1,4). This point is a stable node for 
the S-system (Fig. 5) and a saddle-point for the Z-system (Fig. 6). A general 
stability analysis of stationary transverse current patterns has been given in 
[17]. The stability criterion is 

~(7u + ^ < R~"^ < -<^d, c>0, (20) 

Ta 

where Ai > 0 is the eigenvalue of the unstable mode corresponding to transla- 
tion, ad is the differential conductance, and denotes the Active differential 
conductance for fixed parameter a. According to (20) only fronts with <Td < 0 
can be stabilized for R> 0. This implies that stationary fronts in Z-systems 
driven via an ordinary passive external circuit with iZ > 0 are never stable. 
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Fig. 5. Globally coupled dynamics of lateral current density fronts in an S-system 
(HHED) for positive load J? > 0 and instantaneous feedback, (a): Phase portrait 
including the S-shaped current- voltage characteristic (solid line) with different load 
lines (dotted). The front dynamics is indicated by the trajectories 1,2, 3, 4. The 
fixed point at u = Uco is a stable node, and corresponds to a stationary front. (b,c): 
Decelerated cold fronts evolving either to a stationary front (b; trajectory 1) or to 
the uniform off-state (c; trajectory 2). (d,e): Decelerated hot fronts evolving either 
to a stationary front (e; trajectory 4), or to the uniform on-state (d; trajectory 3). 
Parameters of the load lines: Uo — 11.5, r = 0.42 for trajectories 1 and 4, Uo = 9.4, 
r = 0.15 for trajectory 2 and Uo = 11.0, r = 0.15 for trajectory 3; e = 100, 
Lx = 1000. After [25]. 



The upper bound of the criterion (20) corresponds to the saddle-node bi- 
furcation where the system has one real positive eigenvalue. This indicates 
that the stationary front has lost stability with respect to the translation 
mode, and monotonic front propagation will switch the system to the homoge- 
neous state. The lower bound corresponds to an oscillatory instability where 
a pair of complex conjugate eigenvalues crosses the imaginary axis. Note that 
the main contribution to the differential conductivity of the stationary front 
comes from the shift of the front and therefore generally |(Td| » <j„. 

With increase of e = Tu/to the system experiences a transition from 
instantaneous feedback to delayed feedback. Now the slow relaxation of u 
results in deviations of the trajectories from the load line. For S-shaped char- 
acteristics the fixed point evolves from a stable node to a stable focus (Fig.7). 
This corresponds to oscillatory transient processes leading to the steady state 
(Fig.7, trajectories 1,4). For sufficiently slow feedback the front propagation 
becomes self-similar as in the case of the voltage-controlled conditions. For 
the stationary pattern the increase of e eventually leads to a violation of the 
left inequality in (20) and the fixed point becomes an unstable focus reflecting 
an oscillatory instability of the stationary front (see [26] for an example of 
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Fig. 6. Globally coupled dynamics of lateral fronts in a Z-system (DBRT) for pos- 
itive load ii > 0 and instantaneous feedback, (a): Phase portrait including the 
Z-shaped current-voltage characteristic (solid line) with different load lines (dot- 
ted). The front dynamics is indicated by the trajectories 1,2, 3, 4. The fixed point 
at u = Uco is a saddle-point. The regimes corresponding to the trajectories 1 and 
4 can be realized only for special initi^d conditions. (b,c): Accelerated hot fronts 
for trajectories 1 (b) and 2 (c). (d,e): Accelerated cold fronts for trajectories 3 (d) 
and 4 (e). Parameters of the load lines: Ua = 96, r = 45 for trajectories 1 and 4; 
Uo = 92, r = 25 for trajectory 2, Uq = 96, r = 25 for trajectory 3; £ = 10“^^, 
Lx = 500. After [25]. 



such behaviour). However, since this instability is caused by the interaction of 
the front wall with the boundaries it represents essentially a boundary effect 
which is not relevant for the front dynamics in a large system {Wf Lx)- 
For Z-systems the phase portrait does not undergo qualitative changes with 
increase of e and the stationary point always remains a saddle-point. 



3.3 Global Coupling via Active External Circuit (R<0) 



The type of feedback can be changed if the system is operated by an active 
circuit simulating a negative load resistance R < 0. Such a circuit has been 
implemented [40] in order to stabilize the uniform states corresponding to 
the intermediate branch of the DBRT current-voltage characteristic and can 
also be used in studies of lateral patterns. Note that to secure = RC > 0 
such a circuit should also provide C < 0. 

For R <0 the propagation of a hot front is accompanied by an increase of 
u. That results in positive feedback for S-systems and negative feedback for 
Z-systems. The last case is most interesting here since efficient control over 
front propagation and stabilization of lateral patterns becomes possible. Now 
the front propagation in the Z-system is decelerated. For (7 < 0 the stability 
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Fig. 7. Oscillatory dynamics of globally coupled fronts in an S-system (HHED) in 
the case of delayed feedback (R > 0). (a) Phase portrait including the S-shaped 
current- voltage characteristic (solid line). The load lines (dotted) and the initial 
conditions are as in Fig. 5, s = 10*. In contrast to Fig. 5 the trajectories 1,2, 3, 4 
deviate from the corresponding load lines due to the delay in the feedback. The 
fixed point at u = Uco is a stable focus, (b, c) Oscillatory slowing down of the cold 
(b) and hot (c) front corresponding to trajectories 1 and 4, respectively. After [25]. 



criterion takes the form [17] 



-ad < R ^ < -au H C < 0. (21) 

T'o 

In Eq. (21) the lower and upper bounds correspond to a saddle-node bifurca- 
tion and oscillatory instabilities. According to (21) a stationary pattern with 
ad > 0 can be stable for R < 0,C < 0. For sufficiently small C the fixed point 
is a stable node. Increase of e = t„/to leads to oscillatory motion and the 
fixed point becomes a stable focus. The front behaviour in Z-type systems 
for < 0 is qualitatively the same as in S-type systems for i? > 0. 

However, the implementation of the active external circuit leads also to 
some new regimes which have no analogue for f? > 0. If a spatially extended 
bistable element is operated via an active external circuit temporal instabil- 
ities can be caused by the negative differential conductance of this circuit 
itself. Indeed, for R~^ > -a^ the condition for an oscillatory instability is 
fulfilled even for C = 0. This instability is not related to front oscillations but 
represents circuit induced oscillations. These oscillations can be excluded by 
choosing a negative relaxation time in the external circuit. 

4 Conclusions 

In summary, global constraints in reaction-diffusion systems introduce fea- 
tures of winner-takes-all dynamics and pattern selection. They naturally arise 
in semiconductor transport due to the external load circuit. The dynamics of 
fronts is sensitively modified, depending on the sign of the global feedback and 
the time constants involved. In particular, in bistable semiconductors lateral 
current density fronts are accelerated or decelerated if the feedback is positive 
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or negative, respectively. The type of this feedback is determined by the slope 
of the n(u)— dependence and the type of external load. For positive external 
load i? > 0 the feedback is negative for systems with S-shaped current- 
voltage characteristics and positive for Z-shaped current-voltage character- 
istics (Figs. 5, 6). This results in deceleration and acceleration of the front 
propagation, respectively. The type of the feedback can be reversed if the 
system is operated via an active external circuit simulating negative load 
i? < 0 and capacitance C <0. The case of negative feedback (for Z-systems) 
is of most interest since deceleration and efficient control over fronts becomes 
possible. The propagation of globally coupled fronts is monotonic as long 
as the relaxation time of the external circuit t„ = RC is sufficiently small 
and the feedback upon the front dynamics is instantaneous. Delayed nega- 
tive feedback can result in oscillatory slowing down in both S- and Z-systems. 
Generally, one can conclude that S- and Z-systems are dual. 

The type of feedback is closely related to the stability of stationary lateral 
patterns. It is known that in the presence of global coupling the stability of an 
inhomogeneous pattern (stationary lateral current density front or filament), 
which has one unstable mode in the voltage controlled regime, is determined 
by the sign of its differential conductance. 

Globally coupled dynamics of traveling pulses in excitable media has re- 
cently been studied [41]. Global coupling influences the velocity of a traveling 
pulse but the self-similar character of the motion remains unaltered. As has 
been shown here, in bistable media the global coupling completely destroys 
the self-similarity, resulting in accelerated, decelerated or oscillatory motion. 
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Abstract. In this work we present a review of the more relevant results and con- 
clusions obtained by the authors on the study of the effect of mixing processes on 
diffusion-limited reactions. We investigate the kinetics of the A -|- R — )• 0 diffusion- 
controlled reaction under stoichiometrical conditions in 2D. We study the “anoma- 
lous” kinetic behavior of such reactions and how this behavior is affected by some 
stirring processes. In order to do this we consider steady and turbulent flows and 
in both situations, complex decay patterns axe obtained. The closed topology of 
flow lines in the steady cases and the length and time scales in the turbulent cases 
are going to determine the spatial organization of the system and consequently the 
kinetics of the reaction. 



1 Introduction 

Diffusion-controlled reactions In low-dimensional geometries are well-known 
to exhibit “anomalous” kinetics in the sense that the rate laws for global 
concentrations do not follow the behavior expected from standard law-of- 
mass arguments. In the present work we study an example of this anomalous 
behavior: the diffusion-limited A + B Q reaction. For an initial stoichiomet- 
ric and randomly distributed system, the formal treatment of this problem is 
based on the total homogeneity hypothesis that leads to a decay of the global 
concentration of both reactants that follows c ~ We call this behavior 
classical. 

The usual laws of mass action assume a spatially homogeneous mixture of 
reactants but the mechanism for this homogenization is usually not specified. 
In low dimensions, diffusion is not an efficient mixing mechanism and may 
be incapable of smoothing out reactant concentration inhomogeneities that 
are created by its initial fluctuations. When this happens, the system, that 
initially follows the classical behavior, starts to segregate in clusters (domains 
of either A or B) that grow more and more. Since the reaction only takes 
place at the cluster’s boundaries the rate law is thus, in this case, slower 
than the classical one. This is called the fluctuation-dominated or also the 
diffusion-limited kinetic regime whose decay law follows c ~ where d 

corresponds to the dimensionality of the system. This kinetic law was first 
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deduced by Ovchinnikov and Zeldovich for three dimensions [1] and extended 
for the general d-dimensional case in other works [2, 3]. We shall briefly review 
this standard approach in Sect. 2. 

On the other hand, mixing is a widespread process both in chemical tech- 
nology and also in our everyday life. In general, the knowledge of how flows 
mix can provide a better understanding of some chemical, physical and bio- 
logical processes that take place under the influence of velocity fields. In our 
case we are interested in the effect of mixing flows in our diffusion-controlled 
2D reactions. It might be conceived that hydrodynamic mixing would destroy 
the segregation and restore classical kinetics, but the actual situation is more 
complicated. Actually, 2D flows cannot totally mix such diffusion-controlled 
systems and at long times the c ~ behavior is always recovered. Thus, 
we can say that any flow has its own mixing efficiency and one of the aims 
in the study of stirring flows is the improvement of this property. In relation 
with an irreversible recombination process, we are thus able to quantify the 
mixing efficiency of any 2D flow as well as to study the connection between 
this property and the “physical” characteristics of the flow. 

We are interested in two different kind of flows; steady ones (Sect. 3.1) 
and particular forms of synthetic (kinematic) turbulent fields (Sect. 3. 2). For 
the steady cases the topology of the flow lines will determine the way the 
clusters are going to grow and therefore the different kinetic regimes that 
are obtained. We shall pay attention to the relation between this topology 
and the different intermediate regimes. In the turbulent case we shall study 
the different mixing efficiency depending on the length and time scales of the 
turbulence, as well as the spatial organization of the stirred reactants. 

2 A + J3 — >■ 0 DifFusion-Controlled Reaction 

We can obtain the diffusion-limited kinetic law through a simple dimensional 
argument. It is well-known that for a random distribution of reactants, the 
fluctuations of concentrations are typically on the order of the square root of 
the average local concentrations. A particle that behaves diffusively travels an 
average distance defined by the diffusion length A = (Dt)^/^. For a very high 
reaction rate, the concentration fluctuations on a length scale shorter than A 
have had time to die out, but fluctuations on longer scales are still present. In 
a volume of linear size A, the initial difference between the number of A and 
B is on the order of (coA"^)^/^. This corresponds to an excess concentration 
Cex ~ for this segregated volume. If we consider that the system 

is going to be totally segregated, in an asymptotic regime, we have c = Cex ~ 

Beyond this scaling argument, our analysis is based on the use of reaction- 
diffusion equations. This differs from the more usual, more microscopic ap- 
proach, where it is customary to simulate the system as a lattice gas in which 
reactants are random walkers and in which the reaction occurs when reac- 
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tants step on the same lattice site. The results of direct simulations of the 
reaction-diffusion equations are of course constrained in the same way as are 
the equations themselves, but for being more mesoscopic, require less time 
to cover the different hierarchies of kinetic behaviors. However, care must be 
exercised [4]. 

The mean-field like reaction-diffusion equations for the local concentra- 
tions CA(r,t),CB(r,t) are 

= DAV^CA[r,t) - kcA(r,t)cBir,t), 

~ ^B'^^CB{r,t) - kcA(r,t)cB(r,t). ( 1 ) 

Here fc is a time-independent rate coefficient, and Da and Db are the diffusion 
coefficients of the reactants. When Da = Db (= D) holds, Eqs.(l) can be 
explored to a large extent analytically for the randomly distributed case as 
well as for other initial conditions that show their own particular diffusion- 
limited kinetic behaviors [5,6]. 

We solve numerically the coupled partial differential equations Eqs.(l) 
by using a standard discrete scheme with a centered form for the Laplacian 
operator with periodic boundary conditions and a forward difference in time. 
The initial concentration distribution is taken to be random, with a mean 
for both species equal to 1. We take simple cubic lattices of sidelength L 
and we discretize time and space in increments of At = 0.01 and Ax = 1. 
This choice guarantees that the scheme is numerically stable and convergent 
for the values of k and D used here. In order to obtain a diffusion-limited 
behavior, k is taken much larger than D. We avoid finite-size effects by never 
letting the linear mean cluster size exceed 0.2L. 

In Fig.l we present the results for c(f) (taken as the spatial average of 
either local concentrations) for d = 1,2 and 3 and averaging over 10 different 
realizations for each case. Double-logarithmic scale is used and the asymptotic 
kinetics c ~ is readily recognized. 

As we introduced before, the anomalous kinetics appears due to the seg- 
regation of the system. This segregation makes the reactants separate in do- 
mains and therefore the reaction takes place only at the boundaries of these 
clusters leading to slower overall kinetics. In Fig. 2 one can see how strongly 
segregated is the system by drawing from white to black the value of the 
product CAii,j)cB{i,j) at four different times. The clusters appear in white, 
meanwhile the dark zones correspond to the areas of the system where the 
reaction occurs (reaction zones). 

Clusters emerging during the reaction can be quantitatively analyzed in 
terms of the concentration correlation functions. For the same species we 
have 

r ir- {cAir',t)cA{r' + r,t)) 



( 2 ) 
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rig. 1. Concentration decay for diffusion-limited reactive systems for different di- 
mensionalities. A; = 10 and D = 




Fig. 2. Plots of the structure of the reaction zones corresponding to the time evolu- 
tion of the diffusion-limited binary reaction in two dimensions whose concentration 
decay is presented in Fig.l. 



and similarly for For different species one has 



CAB{r,t) = 



{cA{r',t)cB{r' +r,t)) 

{cA{r,t)){cB{r,t)) 



(3) 



We can calculate analytically these functions by using the difference vari- 
able q{r,t) = CA{r,t) — CB{r,t) in Eqs.(l). For equal diffusion coefficients, 
q{r,i) obeys the diffusion equation = DV^q and therefore, given a initial 
distribution of reactants, can be solved exactly. In the diffusion-limited case 
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{k — >■ oo) the cluster boundaries are so narrow that we can consider that 
CA{r,t) = q{r,t) if q{r,t) > 0 and CB{r,t) = -q{r,t) if q{r,t) < 0. By 
evaluating these expressions in Eqs.(2) and (3) we obtain analytical solutions 
for the correlation functions [5,7,8]. The numerical results and the analytical 
expressions are compared in Fig.3. By using the scaling variable 
we can see how the clusters grow diffusively and how the behavior of the 
correlation functions is superuni versa! since do not depend on the time, the 
value of D and the dimensionality of the system. 




Fig. 3. Concentration correlation functions plotted as a function of for 

different dimensionalities. The solid lines correspond to the analytical results for 
these functions. 



3 Reaction-Diffusion-Advection Model 

We model the system under the i 'luence of mixing by adding an advection 
term to our reaction-diffusion equations, 

^ • '^CA{r,t) = DA^^CA{r,t) - kcA{r,t)cB{r,t), 

• Vcs(r,f) = DB'V^CB{r,t) - kcA{r,t)cB{r,t). (4) 

where v{r,t) corresponds to the mixing flow. We generate the velocity field 
by using the stream function T]{x,y,t): 

v{r,t) = {-dr]/dy,dTi/dx) (5) 



which insures that the flow is incompressible. 
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3.1 Steady Flows 

In this section, rj{x,y,t) is taken to be time-independent and therefore the 
velocity field is so. One of the models that has been considered is the eddy- 
lattice fiow that corresponds to the choice 






2.JLu() 

TITT 



cos(n7ro;/L) cos{imy/L) 



( 6 ) 



where uq is the intensity of the velocity field and n stands for the number of 
eddies along the side of the lattice whose linear dimension is given by L. To 
be consistent with the periodic boundary conditions n is taken to be an even 
integer. 

When analyzing the reaction kinetics under this eddy-flow a very rich 
behavior is found. In Fig.4 we show the whole set of dynamic scenarios to 
which we will refer in what follows. To better understand this kinetic behavior 
we display in Fig. 5 a comprehensive mosaic of patterns for the reaction zones 
of the system at the different regimes. 

First, fluctuation-dominated regime, c ~ (7) appears at very early 

times when the kinetics is still unaffected by the flow. Following this slow tran- 
sient the reaction strongly speeds up, c ~ while entering a regime (77) 
of mixing along the flow lines. This regime is not well-developed in Fig.4(a) 
but using a higher intensity and larger eddies. Fig. 4(b), one can infer that in 
regime 77 the classical c ~ law tends to hold. After this fast regime, the 
system experiences a clear crossover towards a much slower kinetics (777) 
obeying c ~ that corresponds to the diffusion- limited behavior for 

d= 1. During the previous mixing stage the flow has been mixing along the 
direction of the flow lines until the concentric zones connected by the closed 
flow lines are completely homogenized, Fig.5(b). In this situation the flow 
does not mix anymore and only the diffusion perpendicular to the flow lines 
can mix the reactants. Thus, we associate this finding with a diffusion-limited 
kinetics picture for the transversal diffusion across the closed flow lines inside 
the eddies. This behavior is better evidenced in Fig. 4(b) and we can see how 
it starts later and lasts longer when increasing the eddies’ size. At the end of 
stage 777 the reaction inside the eddies is practically finished and the reaction 
zones concentrate at the boundaries between eddies, forming a quasiperiodic 
pattern, Fig. 5(c). In [6] we demonstrated how for a periodic system the con- 
centration decays exponentially. Here similarly, a quasi-exponential decay is 
found in this regime (717). Later on this quasiperiodic arrangement starts to 
disol ve and a coarse-grained structure appears. The individual eddies are now 
the smallest elements of an inhomogeneous structure consisting of large clus- 
ters separated by irregularly patterned reaction zones. Fig. 5(d). In this stage 
(f7) we recover the two-dimensional diffusion-controlled behavior, c ~ . 

Since no closed solutions of the diffusion equation for the eddy-lattice 
flow are known, we can study with more detail the sudden slowing-down of 
the kinetics (777) by using simpler models. A shear-flow, v = {ay,0), has 
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Fig. 4. Double-logaiithmic plots of c(f) for the eddy-lattice flow, (a) Upper panel: 
cas^ with uo = 2, L = 300 and n = 30 showing the whole behavior, (b) Lower panel; 
case with «o = 10, L = 150 and n = 2,4,6 and 10, showing clearly the crossover 
from II to III. 



also closed flow lines which are amenable to an analytical treatment. For 
this flow one obtains the initial I and II regimes and once the mixing stage 
has flnished the system is organized in strips on the x-direction leading to a 
one-dimensional diffusion-controlled behavior {III). In [9-11] we developed 
a complete analysis of these behaviors. 

3.2 Turbulent Flows 

In the case of a kinematic, isotropic, homogeneous and stationary turbulent 
flow, the stream function in Eq.(5) is taken to be a Gaussian random process 
with given correlation properties in space and time. The random function 
ri{x, y, t) is built up from its Fourier-harmonics, each one of them satisfying 
its own Langevin equation. A detailed description of the numerical procedure 
is given in [12]. For the flow used here we adopt Kraichnan’s energy spectrum 
E{k) oc k^exp{-k^lk^). The correlation length and the correlation time are 
given by /q = and to = where u is the viscosity of the 
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Fig. 5. Mosaic of patterns displaying the topology of the reaction zones for four 
different stages showed in Fig. 4. (a) Upper left: snapshot at short time for the case 
with uo = 10 and n = 2, corresponding to the mixing regime II. (b) Upper right; 
the same as in (a) but for a longer time that stand for the slow regime III. (c) 
Lower left: intermediate time for a flow with tio = 10 and n = 6, showing regime IV. 
(d) Lower right; very late time for a case with uo = 2 and n = 30, corresponding 
to regime V. 



fluid. A further parameter of the simulations is the intensity of the velocity 
field, ul = dkE(k). 

Somewhat unexpectedly, the much more complex turbulent flow leads to 
a simple kinetic behavior. The concentration decay of a turbulent case is 
presented in Fig. 6(a). Here three types of behavior are seen. After a slow 
initial stage, the system enters a mixing-aided regime, c ~ whose length 
scale is dictated by the correlation length of the flow. Later on it crosses over 
to a diffusion controlled regime where c ~ shows up. The corresponding 
decay at that time is governed by an effective turbulent diffusion coefficient. 
We also display in Fig.6(a) the decay for two non-advected systems, one with 
the bare diffusion coefficient D and the other with the effective turbulent 
diffusion coefficient Des calculated for an advected scalar, see [13]. ft is clearly 
seen how the mixing stage of the turbulent case interpolates between the 
short-time behavior governed by D and the long-time behavior governed by 
Z>eff- In any case, as we found for the steady flows, turbulent stirring does 
not imply mixing on very large scales either and it is indeed incapable to 
overcome segregation; the long-time behavior is hence diffusion-controlled. 

One of the most interesting points is to investigate the spatial structura- 
tion of the system under turbulence during the mixing stage. To do this we 
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Fig. 6. (a) Up: c{t) for a turbulent case with Uq = 1.2, to = 2 and lo = 1.7. 
Lines (a) and (b) correspond to a nonadvected reactive systems with Z) = 0.1 and 
Deff = 1.529 respectively, (b) Down: Spatial organization for the reaction zones of 
the turbulent advected system in the upper panel of this figiure. 



consider the reaction-rate correlation functions defined as 



Q{r,t) 



{R(r\t)R{r' + r,t)) 
{RHr,t)) 



( 7 ) 



where R{r,t) = CA{r,t)cB(r,t). In Fig.7 we display Q{r,t) at different times 
for fc = 2 and the same advection parameters as in Fig. 6. We can easily show 
[14] that the width of the peak of Q{r,t) corresponds to the width of the 
reaction zones (w), whereas the flat value at large r {Q^a = Q(oo, t)) denotes 
the portion of the system occupied by reaction zones. Using some nice scaling 
arguments [7, 14] one obtains that for a two-dimensional diffusion-limited 
system, u> scales as u and Q QQ decreases monotonously as Q co ^ ^ . 

These scalings are not contradictory because the decrease oiQoo and growth 
of w are possible at the same time if we take into account that the number of 
clusters in the system decays with time. These predictions are well fulfilled 
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for the non-advected diffusion-limited case and for the advected cases at long 
times (when the diffusion-limited behavior is recovered) as well [14]. 




Fig. 7. Q{r,t) vs. the scaled variable at different times of the advected case. 

Notice how the peak scales with only at long times and how the flat value Qoo 
shows an increase during the mixing range and a monotonic decay at longer times. 

Nevertheless during the mixing stage, c ~ another behavior appears 
by looking at Fig. 7. We can see how for the times when mixing applies {t 
between 20 and 60), u grows faster than and besides, Qoo even grows. 
This means that within the mixing range, the reaction zone’s width grows 
so fast that more than compensates for the loss in perimeter of the clusters, 
leading to an increase of the volume occupied by reaction zones. This growth 
takes place until w gets to be of the order of the maximal mixing length in 
the flow, so that the behavior on larger scales is purely diffusive. 

Thus, we have seen how the mixing stage, c ~ can coexist with segre- 
gation {Qoo < !)■ Actually our system always will be somewhere in between 
two extreme situations. For small values of k and/or high flow intensities, 
Qoo is going to be close to 1 and therefore we conclude that the system is al- 
most homogenized during the mixing period. This is the A:-controlled regime 
that gives us the c ~ classical behavior. On the other hand, for large 
k and/or moderate flows, the system shows Qoo far from 1 and therefore a 
clear segregation behavior. This is the signature of an advection-controlled 
regime where the segregation is compatible with c ~ leading to a pseudo- 
classical behavior. 



4 Conclusions 

The efficiency of mixing processes is determined by the local and global prop- 
erties of the flow. We have studied a reactive system in which the transport 
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processes cannot prevent the segregation of reactants and therefore the cor- 
repondent kinetics is slower than the predicted assuming total homogeneity. 
We have investigated the effect of some mixing flows on this system in two 
dimensions and by comparing the different kinetic regimes we obtain, we can 
learn about the efficiency of such flows. We have considered two kinds of 
flows, first, a couple of steady flows and, second, a flow which is random in 
space and time. In both cases a large variety of rather unexpected kinetic 
behaviors appears, which are characterized by different power-laws. In both 
situations the reactions initially display a fast (“classical”) regime which is 
due to effective mixing at short length scales). At larger scales, i.e. longer 
times, turbulent flows recover the diffusion-limited behavior but now deter- 
mined by an effective coefficient D^fi. We have studied in this case how the 
length and time scales of the flow affect both regimes. We have also seen how, 
under some circumstances (high reaction rate and moderate turbulence), the 
“classical” behavior can even coexists with clusterization. In the case of 
steady flows, the overall kinetics is much more complex since we can find 
diffusion-limited transients that would correspond to reduced dimensionali- 
ties. This is due to the existence of closed flow lines in such systems. We have 
studied the relation between the topology of the flow and those “strange” 
behaviors by using an eddy-lattice flow and a shear flow in two dimensions. 
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Abstract. Astrocyte-signaling has been observed in cell cultures and brain slices 
in the form of calcium waves. Their functional relevance for neuronal communi- 
cation, brain functions and diseases is, however, not understood. In this paper, 
the propagation of intercellular calcium waves is modeled in terms of waves in ex- 
citable media on a stochastic support. We utilize a novel method to decompose the 
spatiotemporal patterns into space-time clusters (wave fragments). Based on this 
cluster decomposition, a statistical description of wave patterns is developed. 



1 Calcium waves 

Calcium plays an important role in many cellular functions. It is essential for 
muscle contraction and cardiac electrophysiology and long term potentiation 
in neurons to name only a few. The typical concentration of calcium in a cell 
is 0.1/iM. Since higher concentrations are toxic if maintained for a longer 
time, the cell has several mechanisms to remove calcium from the cytoplasm. 
Calcium can be removed from the cytoplasm by active pumps or by concen- 
trating it in internal compartments (internal stores), bound by a membrane. 
Calcium can enter the cytoplasm in two different ways: from extracellular 
space through calcium channels and from internal storage through IP3 bind- 
ing to IP3-receptors on the membrane of internal calcium stores. Binding of 
extracellular neurotransmitter (such as Glutamate) can cause the intracellu- 
lar release of IP3. IP 3 binds the membrane of an internal calcium store and 
calcium is released into the cytoplasm. Calcium releases more calcium from 
internal storages through calcium-induced calcium release. This second mech- 
anism describes an instability leading to a quick increase of calcium in the 
cytoplasm. Calcium is removed from the cytoplasm by slower active pumps. 
Assuming that the intracellular IP3 concentration remain constant, the cy- 
cle can begin again leading to stationary oscillations of the concentration of 
intracellular calcium [1]. 

The oscillations of the calcium concentrations occur often nonuniformly 
across the cell, but rather is organized in the form of intracellular waves [2]. 
The speed of these intracellular calcium waves is of the order of several fim 
per second and thus very slow in comparison to neuronal signal propagation. 
Intercellular calcium waves propagating from cell to cell have been observed 
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in hippocampal brain slices [3] and glial cell cultures [4, 5] . A model for inter- 
cellular calcium waves has been put forward by Boitano et al. [ 6 ] . According 
to this model, IPS released in one cell by agonist binding diffuses through the 
cell culture via the gap-junctions. IPS binds to the internal calcium storages 
and calcium is released into the cytoplasm fueling the propagation of the 
calcium waves via calcium induced calcium release from internal storages. 
IPS is diffusing through the gap junctions. Only if the concentration of IPS 
is sufficiently large in a neighbor cell the wave will propagate reliably. IPS, 
thus provides the support for calcium waves. For low concentrations of IPS 
the probability of binding becomes small and the trigger of the wave becomes 
more stochastic. In such a situation IPS provided stochastic support for the 
calcium wave. An additional, hypothetical mechanism for kainate-induced in- 
tercellular calcium wave propagation involoves the sodium/calcium exchanger 
pump [7]. 

Astrocytic calcium waves in astrocyte syncytium are revealed using the 
calcium sensitive fluoroprobe, Fluo-3, and time lapse imaging using a laser 
confocal microscope [4]. In the lower panel of Fig. 1, a sequence of snapshots of 
imaged calcium activity in an astrocyte syncytium obtained from rat-brain 
exposed to 100 //M dose of kainate are shown. Neurotransmitter has been 
perfused over the entire cell culture, mimicking neuronal activity over the 
entire system. 



2 Nonlinear Waves on a Stochastic Support 

A discrete version of an excitable medium can be modeled by a square array 
of excitable three-state cells at the positions Xij = iax + jay with the unit 
vectors x and ^ in x and ^-directions, respectively, and the lattice spacing 
a [ 8 ]. Approaches like this have been used for modeling cardiac dynamics 
[9] and the visual cortex [10,11]. Here, the quiescent state corresponds to 
an astrocyte with a normal calcium concentration, i.e. no calcium wave. The 
excited state corresponds to an astrocyte that either contains enough IPS that 
a wave can propagate. The excitable dynamics is driven by the fluctuating 
concentration of IPS Vij modeled by the Langevin equations 

v'ij = -IVij 4 - ( 1 ) 

with zero mean, Gaussian white noise with the correlation function 

< >= 2(T^5(t - t')'5(o),(W) (2) 

The threshold for excitation for each cell is denoted by b. The constant 7 
describes the rate at which fluctuations decay and denotes the spatially 
homogeneous variance of the fluctuations. When the cells {kl) are excited, 
they do interact with their neighbors within a finite neighborhood by pulse 
interaction: All excited cells {kl) send out a signal to the cells {ij) in their 
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neighborhood that increases their concentration Vij and thus increases their 
chance to become excited. The signaling amplitude between the cells depends 
exponentially on the distance rij^hi between the cells. Integrated over the time 
interval At the total change of Vij is given by: 

Vij{t + At) = Vij{t) exp{-'yAt) + - exp{-2'YAt))Gij 

+ K^^exp Pki{t)- (3) 

where Gy are Gaussian distributed random numbers with unit variance. Here 
A describes the interaction range and K a coupling constant. The indicator 
function pki {t) is unity at sites where the cells are excited at time t and zero 
elsewhere, i.e. 



pki{t) - 0{vki{t) - b) (4) 

Each cell undergoes a recovery period after the excitatory phase. The 
proper scaling of this model is given by Xij — >• Xij /b,t 'yt,a^ -> cr^ , 7 -> 

'yAt, K K/b. The value of the threshold is normalized to unity. 

This model shows for large coupling K (in the absence of noise) the typical 
excitation patterns of excitable media, i.e. rotating spiral waves or target 
waves. This regime, however, is not suitable for modeling the finite lifetime 
of the calcium waves. To maintain a firing pattern, the coupling K has to 
exceed a critical value Kq, which can be approximated for small -\/A and large 
values of 7 by 



^ ^ 2 A 1 

° ~ 7 T erf(2/AM - VA) - exi{^/XM) 

For K < Kq , one can observe patterns that are best described as a hybrid 
of avalanches and nonlinear waves [18]. A sequence of snapshots of an array 
of size 201 X 201 is compared in the upper panel of Fig. 1 for 7 = 20, and 
K = 0.07 < Kq 0.09 with an actual sequence of snapshots of a calcium 
waves. The common features of the simulations and the calcium waves are 
their spontaneous occurence, their local coherence and their disappearance 
after some lifetime. 

3 Spatiotemporal Organization 

3.1 Intervalfields 

The interval field at a location x at time t is defined as the length of the 
most recent time interval between two successive events of excitation (at lo- 
cation X subtracted by the momentary array-averaged interval between two 
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Fig. 1 . Snapshots of thermal waves are shown in chronological sequence. The size of 
the array is 101 x 101. The parameters are K = 0.07 < Ko ~ 0.09 , 7 = 20, A = 0.1 
and = 0.15. The first frame (a) showss the initial condition. In the subse- 
quent frames (c-f) snapshots of the array at times h = lOO^t, tc = 200 At, td = 
300 At, te = 400 At and t/ = 500/lt are shown. Black dots corresponds to cells in 
the excited state. Gray dots indicate refractory cells. 



successive excitation events. It thus describes how fast a single site cycles 
through its states in comparison with the average. Each time an element en- 
ters the excited state, a new interval is assigned. In case of a perfect spiral 
pattern, obtained at large values for the coupling K, the interval-field - ini- 
tially depending on the initial condition approaches a uniform distribution 
I(x) = const, describing spatiotemporal synchronization in the sense that 
all excitable cells are on a cycle of the same period - although their ampli- 
tudes can be desynchronized. This concept is related but not identical to 
the concept of phase synchronization [14-17]. In the Fig.2, the interval-fields 
and the corresponding snapshots are shown for a noisy spiral pattern above 
propagation threshold. In 3, snapshots and interval-fields are shown for a 
sub-threshold system. The onset of thermal patterns goes parallel with the 
onset of interval-organization in clusters of organized activity. 



3.2 Space-Time Cluster Analysis 

Spatiotemporal patterns with noise, especially subthreshold patterns dis- 
cussed in the previous section can not be easily classified as a spiral wave 
or a target wave. These waves have a statistical component that calls for 
a statistical method in describing them. Comparison between theory and 
experiment for the very same reason has to be done based on a statistical 
method. The development of a statistical description of patterns is an active 
field of research, particularly in the context of spatiotemporal chaos [12, 13]. 
We utilize an event-based method [18] that decomposes the spatiotemporal 
evolution into space-time clusters. The method works as follows: 
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Fig. 2. The Interval field of a noisy rotating spiral wave, seeded by a stripe of 
excited cells, is shown as it approaches an almost uniform interval field. The zero- 
level of the interval field is represented by the gray scale of the right panel. A 
lighter gray represents a longer interval and a darker gray a shorter interval than 
the average. The parameters are ■y — 1,K = 0.2, = 0.5 and A = 1. 




Fig. 3. The Interval field of a rotating spiral wave, seeded by a stripe of excited 
cells, is shown as it approaches a uniform interval. Increasing interval length is 
coded by increasing gray scale. The parameters are 7 = 1, = 0.08, = 0.16 and 

A= 1. 



First, we stack a temporal sequence of Nt snapshots of the array, taken 
at times = nAt to obtain a large space-time cube, which carries all the 
spatiotemporal information within the time interval NfAt. In the second step, 
we draw a small cube around each excited cell with a spatial side-length dg 
and a temporal side-length d(. The temporal and spatial side lengths can 
be varied to analyze the system on different length and time scales. In this 
paper, we use for the temporal side length dt the elementary time step At 
and for the spatial side length dg the lattice constant a, i.e. only the nearest 
neighbors produce overlapping small cubes. Overlapping small cubes in the 
time-forward direction form objects which we have termed coherent space- 
time clusters. Collisions of waves need to be treated with a set of rules: 

• When two waves merge, they can propagate after the collision as one 
wave. In this case, the younger cluster is terminated at the merging point 
and the outgoing wave is is considered part of the cluster of the incoming 
wave. This rule separates off small wave fragments that merge into a 
larger wave. 

• When two waves merge, they can branch off following the collision and 
propagate as separate waves. In this case, the younger cluster is termi- 
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nated at the merging point and both outgoing waves are considered part 
of the cluster of the incoming wave. Two branching structures occur after 
collision of two open waves (wave fragments) . 

• Local propagation failure can cause the breakup of a wave into two frag- 
ments. Since both fragments originate from the same mother wave, they 
count as one cluster. This rule avoids e.g. artificial additional clusters 
when a wave collides with a boundary of the system. 

The lifetime of a cluster is limited by collision with another cluster or 
spontaneous disappearance. The size s of a coherent cluster is defined as its 
space-time volume (in units of the small cubes) throughout its entire lifetime. 
A characterization of the patterns is the histogram of cluster sizes n(s), i.e. 
the number of clusters of size s. The cluster size distribution is obtained after 
normalization as 



In Fig. 4, the cluster size distribution of a super-threshold simulation 
K > Kq IS shown. The initial pattern is a stripe of excited cells with a 
refractory layer attached at one side. The initial stripe develops into a rotat- 
ing spiral waves that collides with other noise-nucleated target waves. The 
spiral wave propagates the collision-induced defects away from the core and 
finally develops into a almost perfect spiral wave with a fuzzy wave front. For 
small cluster sizes (1-10 pixels), the cluster size distribution follows a power 
law with an exponent of approximately 4. There is one dominating huge clus- 
ter that forms the backbone of the temporal evolution of the array. Such a 
mother cluster is typical for systems above propagation threshold [19], The 
coverage distribution (see below) reflects the mother cluster by the large peak 
at its large size. For thermal waves below propagation threshold, i.e. K < Kq, 
a typical cluster size distribution is shown in Fig. 5. The regime where the 
cluster size distribution follows a power law is extended to large cluster sizes 
and the exponent of the power law is significantly smaller, i.e. approximately 
2. There is not a large dominant mother cluster. This indicates that the life 
and death of of clusters over a large range in size are controlled by stochastic 
events. The coverage distribution has a large peak at small clusters and only 
a weak increase at large clusters reflecting the lack of a mother cluster. The 
weak increase corresponds to single clusters of larger sizes that produce a 
linear increase in coverage with size. As the coupling parameter approaches 
the propagtion threshold, more clusters of large size occur and the coverage 
distribution becomes bimodal with a peak at small clusters and a peak at 
large clusters (see Fig. 6). 

The cluster-size distribution does not weigh the clusters with respect to 
their relevance for the entire spatiotemporal dynamics. For systems above 
propagation threshold, the mother cluster is clearly dominating and should 
weigh according to its size. One w'ay to accomplish this, is to weigh the 
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Fig. 4. Cluster size distribution (a) of the temporal evolution of the array of size 
201. The parameters are it" = 0.14, A = 0.1, = 0.3 and 7 = 1 . The initial 

condition is an excited strip (black) with a refractory layer attached. The clusters 
have been collected over a time interval of lOOO^t. The coverage distribution (b) 
is low at small clusters and dominated by one huge cluster. Correspondingly, the 
cluster entropy is small S = 0.31. 





Fig. 5. Cluster size distribution (a) obtained from simulations of an array of size 
201 X 201 at the parameters K = 0.08 < Ko w 0.09 , 7 = 1, A = 0.1 and = 0.18. 
The clusters are tracked for approximately 1000 time steps At. The initial condition 
consists of an excited strip of cells attached by a refractory strip. The coverage 
distribution (b) is dominated by a wider range of clusters in comparison to Fig.4. 
The cluster entropy is accordingly larger (S = 4.1). 



clusters by their relative contribution to the entire pattern. The groups of all 
clusters of size s cover the volumes n{s)s. Normalizing this coverage to the 
entire volume of the pattern, i.e. vtot = ti(l) + 2n(2) + 3n(3) + ... we obtain 
the relative coverage distribution 



u(s) = 



sn{s) 
Es' sn{s') 



( 7 ) 



The coverage distribution describes the probability that an excited cell, 
arbitrarily picked at any time during the time interval where clusters are 
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recorded, belongs to a space-time cluster of size s. The coverage distributions 
corresponding to the cluster size distributions are shown also in Fig. 4. In 
the superthreshold case (K = 0.14), the coverage is dominated by the large 
mother cluster while the small clusters do not contribute significantly. In the 
sub-threshold case K = 0.08, a much larger range of clusters contribute to 
the total coverage. A measure for the uncertainty of membership in a cluster 
of a certain length is thus the cluster entropy [19] 

5 = - iis Inrig = In < s > — sps Infsp^). (8) 

< s > 

S S 

The entropy vanishes if the excited sites belong to only one cluster class 
Cg (r;^ = 1), e.g., the spatiotemporal pattern consists of either a single cluster 
or clusters of only one size. A vanishing entropy does not necessarily require a 
‘simple’ initial state but can also arise from complex initial conditions, such 
as many spiral waves with randomly selected cores, if an inherent process 
for generating new cluster sources is lacking. The collision and merging of 
uncorrelated clusters then occurs over a transient time to yield one surviving 
cluster. The artificial fracturing of waves at boundaries does not affect the 
entropy, since the fractured waves belong to the same coherent parent struc- 
ture. The entropy in the super-threshold case {K = 0.14) is 5 = 0.31 while 
it is 5 = 4.1 in the sub-threshold case K = 0.08. This large entropy reflects 
the large range of relevant cluster-sizes building up the entire patterns. The 
coverage distribution close to propagation threshold (see Fig.6) where the 
development of large clusters is significantly enhanced, exhibits a peak at 
small clusters, a decay and another peak at large clusters. The corresponding 
entropy assumes its maximum value of (5 w 5.1). 




Fig. 6. Cluster size distribution (a) and coverage distribution (b) obtained from 
simulations of an array of size 201 x 201 at the parameters K = 0.085 < Ko ~ 
0.09 , 7 = 1, A = 0.1 and = 0.18. The clusters are tracked for approximately 1000 
time steps At. The initial condition consists of an excited strip of cells attached by 
a refractory strip. 
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Fig. 7. The cluster-size distribution (a) is shown for a sequence of 100 sliding- 
reference subtracted frames. The original frames (resolution 640 x 480) has been 
coarse grained to frames of resolution 160 x 160 by averaging the grayscales over 
areas of size 4x3 pixels. Subsequently the frames are subject to binary filtering. 
Calcium activity of less than 50 percent of the average is considered not calcium 
active. The other sites are considered CtJcium active. Then clusters decomposition 
is applied. The histogram of cluster sizes exhibits for small clusters a power law with 
an exponential cut-off and a slower decay for larger clusters that form the backbone 
of the calcium pattern. The coverage distribution v(s) has a peak at small clusters 
and another one at large clusters. This broad distribution of relevant cluster sizes 
causes the cluster entropy to be relatively large (5 = 4.1). 



4 Calcium Wave Analysis 

In this section we analyze the calcium wave patterns obtained from cul- 
tures of hippocampal astrocytes of rat brain. The size of the culture under 
investigation includes about 500 astrocytes. First the cells are loaded with 
calcium-sensitive fluoroprobe, Fluo-3M. Minutes after kainate is perfused ho- 
mogeneously over the culture, calcium waves all across the specimen can be 
observed. The fluorescent activity reflects calcium concentration in the astro- 
cytes. In order to separate the waves from the background (that also changes 
activity during stimulation), subsequent frames of fluorescent activity are 
subtracted from each other to record increases in calcium activity. (At pix- 
els where the fluorescence is decresing, the difference value is set to zero.) 
Applying the cluster method described in the previous section to these sub- 
tracted waves, yields cluster size and coverage distributions shown in Fig. 7. 
The shape of the coverage distribution resembles the shape of the coverage 
distribution of the model close but below the propagation threshold. 



5 Conclusions 

Using a cluster-decomposition scheme, we have shown that the statistical 
features of kainate-induced calcium waves in astrocyte syncytia obtained from 
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healthy hippocampal rat brain exhibits features similar to those of excitable 
waves close to but below propagation threshold. 
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Abstract. A minimal stochastic field equation aimed at modeling the amorphous 
surface growth generated by physical vapor deposition is derived, analyzed, and 
related to the underlying microscopic mechanisms. 



1 Introduction and Basics 

Since the formation and growth of interfaces are ubiquitous in nature and in 
a variety of technological applications, the theoretical understanding of their 
kinetics on a microscopic as well as on a mesoscopic level constitutes one of 
the major challenges in physics and material science [1-3]. In particular, the 
growth of solid amorphous films generated by physical vapor deposition that 
is important e.g. in the context of coating and the manufacturing of thin 
glassy ZrAlCu films has recently attracted interest [4-8] in material science. 
The focus of this contribution is to develop and to analyze a minimal model 
in form of a stochastic field equation that is appropriate to describe the 
spatio-temporal evolution of amorphous surface growth processes. 

In its most elementary version, the generic setup of such a surface growth 
process, cf. also Fig. 1, consists of an initially almost flat substrate and a 
vapor particle beam being determined by the deposition flux and directed 
perpendicular to the substrate. In vapor deposition [4-6], the deposition flux 
is (i) typically low-energetic implying that no kick-off of surface particles 
occurs and (ii) basically constant in space and time with some weak super- 
imposed spatio-temporal fluctuations originating from the particle source. 
The particles from the beam are deposited at the surface and undergo vari- 
ous surface diffusion processes until they arrive at their final position. With 
time, this creates a growing layer build up by the deposited particles. The 
surface of the layer is characterized by its height or morphology H{x,t) at 
time t and at the substrate location x = (x,y). Microscopically speaking, 
the evolution of the surface morphology results from the only partly explored 
interaction of particles to be deposited at the surface and the already con- 
densed particles. As experiments reveal [4-6], however, the spatio-temporal 
evolution of the surface morphology on a mesoscopic scale can be interpreted 
as the interplay of three diff'erent mechanisms: roughening, smoothening and 
pattern formation. 
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Fig. 1. Sketch of a vapor deposition experiment for amorphous thin film growth 



Modern experimental investigation tools such as scanning tunneling mi- 
croscopy combined with image processing allow for a detailed resolution of 
the surface morphology and its spatio-temporal evolution [4-6]. The obtained 
data set, however, is too immense and the data also contain some degree of 
stochasticity due to the small deposition noise resulting from the particle 
source. Therefore, an appropriate quantitative statistical measure of the in- 
formation on height variations and lateral correlations is given by the height- 
height-correlation function 

C{r,t) = {{[H{x + r,t)~ {H)J [H{x,t) - (H) J)„)^ . (1) 

Here, (...),, denotes an average over different samples (ensemble average), 
(Px... the spatial average over a sample area of size L^, and 
{H)x = (fT)a,(t) = {H{x,t))x the spatially averaged surface profile at time t. 
Prom C{r, t) the two most important global quantities that characterize the 
surface morphology can be determined: (i) The correlation length Rc{t) that 
is given by the first maximum of C{r,t) for non-zero r, i.e. 

Rc{t) — min{r > 0 | drC{r,t) = 0, d^C{r,t) < 0}, (2) 

and, therefore, determines the typical length scale over which height fluc- 
tuations are correlated, and (ii) the surface roughness or root mean square 
deviation of the relative height fluctuations w{t) that is determined by the 
r = 0 limit of C(r, t), 

w^{t)=C{0,t). (3) 

Any successful modeling attempt of the spatio-temporal evolution of H{x, t) 
requires at least the validation of the temporal evolution of Rc{t) and w(t) 
in comparison to the experimental data. 

2 Functional Form of the Growth Equation 

As a first step towards a theoretical modeling, we use the machinery of 
stochastic field equations as a tool for the understanding and interpreta- 
tion of the growth dynamics. The basic philosophy behind this approach is 
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to disregard the microscopic details of the particle interaction and to consider 
the growth process on a slighty larger length scale where the surface mor- 
phology can be treated in form of a continuum variable. Primary focus is the 
functional form of an appropriate evolution equation for Therefore, 

the general starting point is given by an ansatz of the form 

dtH = G[H,VH,x,t] + I{x,t) (4) 

where I{x, t) represents the deposition flux and the functional G[H, VH, x, t] 
comprises all physical mechanisms leading to growth and relaxational pro- 
cesses on the surface. Such an approach, however, is implicitly limited by the 
fact that the surface morphology H{x,t) is uniquely defined (single-valued in 
x), i.e. that overhangs in the surface morphology do not appear. In vapor de- 
position experiments [4-6], the deposition flux is basically constant with some 
small superimposed stochasticity resulting from the particle source. There- 
fore, the deposition flux can be split into a spatio-temporally constant mean 
deposition flux F and a fluctuating part 

I{x,t) = F + T]{x,t). (5) 

Here r}(x,t) represents spatio-temporal Gaussian white noise determined by 

{ri{x,t))n =0 (6) 

{ri{x,t)r]{x',t'))^ = 2D6{x - x')6{t - t') (7) 

where (...),, denotes the ensemble average. Further simplification of (4) can be 
obtained by invoking standard symmetry requirements [2]: (i) invariance un- 
der translation in time, t -> t-f-r, since the form of (4) should be independent 
of the choice of the origin of time and (ii) invariance under translation in the 
direction perpendicular to the growth direction, x — >• a; -|-i, to exclude depen- 
dences on the choice of the origin of the coordinate system at the substrate. 
These two invariances exclude the appearance of an explicit dependence on 
the time t and the spatial position x in G, respectively. 

Moreover, invariance under translation in growth direction, H H + z, 
must also be considered since (4) should be independent on the choice of 
the origin of the fJ-axis. This symmetry directly excludes the appearance of 
H{x,t) in G. Therefore, only gradients and higher order spatial derivatives of 
H{x,t) can enter in the functional G. By the way, the presence of the latter 
symmetry also distinguishes surface growth equations from other pattern 
forming equations such as the Ginzburg-Landau equation in the context of 
convection. 

Since the mean deposition fiux F is constant it proofs useful to introduce 
the height profile h{x,t) — H{x,t) — Ft in the frame comoving with the 
velocity F. Then, (4) simplifies to 



dth = G[V/i] -I- Ti{x, t). 



( 8 ) 
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Due to the isotropy of the amorphous phase, invariance under rotation and 
reflection in the plane perpendicular to the growth direction must also be 
regarded. This rules out any odd derivatives of h in G and implies that 
V-operators entering the various contributions in G must be multiplied in 
couples by scalar multiplication. 

Assuming that all surface relaxation processes are local, we finally ex- 
pand the functional G in a power series in all possible spatial derivatives of 
h and keep only the terms that are linear or quadratic in h and only possess 
a maximum of four V-operators. As a result of the afore-mentioned symme- 
tries, the deterministic part of (8) can only consist of the terms V^h, (V/i)^, 
V*/i, V^(V/i)^, and V ■ [(Vh)(V^/i)]. The last term can be slightly 

rearranged in the form 



V ■ [(V/i)(V^/i)] = ^v2(Vh)2 + 2M 



(9) 



with 



M = det 



/ dlh dydxh\ 
\dxdyh dyh J ’ 



( 10 ) 



so that effectively only the functionally different terms V^/i, (V/i)^, V^h, 
V^(Vh)^, and M appear in G. Consequently, the functional form of 

the growth equation for amorphous films is given explicitly by 



dlh = fli V^/i + 02 V^/i + + ai{Vhf + + ogM + r?. (11) 



The approach of determining the leading order functional form of the growth 
equation does not reveal the sign of the coefficients Oj, i = 1,..,6, and the 
physical significance of the corresponding terms in (11). Focussing on the 
physics of amorphous growth, the coefficients a, will be connected to the 
underlying microscopic processes in the next section. 

Several remarks are in order. 

(i) Equation (11) constitutes a systematic expansion of (4) derived by 
use of the afore-mentioned symmetry arguments and by taking into account 
all possible combinations up to O(V^) and 0{h^). It consists of two linear 
terms and four nonlinear terms in h. The term being proportional to 
becomes zero in the one-dimensional limit. This shows the principal problem 
that one-dimensionally motivated surface growth equations cannot be carried 
over to the two-dimensional case by simply replacing 3a, V. Moreover, it is 
interesting to note that Lai and Das Sarma [9] have also attempted to derive 
the leading order functional form of a growth equation using isotropy and the 
fact that the functional G in (8) is a scalar. Their result, however, significantly 
differs from (11) since the terms as(V^/i)^ and a^M are missing. Therefore, 
we conclude that Lai and Das Sarma’s growth equation [9] represents an 
inconsistent systematic expansion since the terms {dlh) (dyh) — {dxdyh^ and 
{dlh)^ -t- {dlh)^ -I- 2{dlh){dyh) are not properly taken into account. 
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(ii) The growth equation (11) contains several known limiting cases. The 
limit Oj = 0 for i = 1, ..,6, dth = r/, is considered as an appropriate model for 
random deposition [2], Setting Oj = 0 for f = 2, 6, dth = ai + t], yields 
the Edwards-Wilkinson (EW) equation originally motivated in the context 
of granular systems [10], The limit aj = 0 for i = 2, 3, 5, 6, determines the 
Kardar-Parisi-Zhang (KPZ) equation, dth = oiV^/i + a4(V/i)^ +77, being the 
paradigm for a stochastic roughening process [11]. Finally, the limit a, = 0 
for * = 3, 5, 6, dfh = ai + a2V^/i + a4(Vh)^ + 77, leads to the stochastic 
version of the Kuramoto-Sivashinsky equation. 

(iii) Besides the invariances already invoked for its derivation, the growth 
equation (11) possesses an interesting additional symmetry: It remains in- 
variant under the combined transformation 



{h, 03, fl4, 05, Ug} -4 { — h, —03, —04) — 05, — Og}. (12) 

As a consequence, one has to expect that a simultaneous change of the sign 
of the coefficients 03,04,05,06 only leads to an inversion of the surface pro- 
file h{x,t) about h = Q. Note, however, that (11) does not possess mirror 
symmetry about h = 0, i.e. it does not fulfil the up/down invariance h -¥ —h 
(without inversion of the signs of the nonlinear coefficients). This already 
implies some degree of asymmetry of the resulting surface profile h{x,t). 

(iv) In the context of the related molecular beam epitaxy, a frequently 
invoked further requirement on surface growth equations [2,3] is that the 
functional G should be represented by the divergence of a surface current, 
G = -V • j(3(V/i) since no desorption of particles occurs. Such an assump- 
tion directly rules out the appearance of a KPZ term (V/i)^ and the term 
(V2/l)2 in G. It also implies that the spatial and ensemble averaged height 
is related to the deposition flux by {{H{x,t))^)x = Ft or, equivalently, that 
{{h{x,t))rj)x = 0 holds. The afore-mentioned assumption, however, also im- 
plicitly implies that no coarse-grained density variations can occur. In the 
presence of local density variations, a discussion starting from the condition 
that no incoming particles are lost (cf. the following section) can lead to a 
KPZ term (Vfi)^ and a term (V^/t)^ and, therefore, also to a nonzero ex- 
cess velocity v = {{dth)^)a. = ((a4(V/i)^ +a5(V^/i)^),,)a, of the surface profile 
h{x, t). 

3 Physical Interpretation of the Growth Equation 

In this section, we relate the various terms appearing in the growth equa- 
tion (11) to the underlying microscopic mechanisms that dominate physical 
vapor deposition. This also leads to insights into the signs and the order of 
magnitude of the appearing coefficents in (11). 

The two terms in (11) that are proportional to ai and ug can be inter- 
preted as follows. The arriving particles from the beam experience close to 
the growing surface a deflection due to the interatomic attractive interaction 
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vapor particle beam 




Fig. 2. Microscopic effects of amorphous surface growth. Left part; Inflection of 
particles due to interatomic interaction. Middle part: Surface diffusion of deposited 
particles due to surface relaxation. Right part: Equilibration of the inhomogeneous 
particle concentration due to the geometry of the surface 



with the already condensed surface particles. Therefore, the particles do not 
arrive perpendicular to the substrate orientation, but perpendicular to the 
surface. This directly implies that more particles arrive at positions at the 
surface with negative curvature, V^/i < 0, than at positions with positive 
curvature > 0. We refer to Ref. [12] for experimental indications of the 
relevance of this effect. To model this scenario in a dynamical way, we use 
the idealization that (i) the particles experience a change of direction only if 
they reach a critical distance b (the effective range of the interaction) from 
the surface and (ii) are then attracted such that they arrive perpendicular 
to the surface, cf. left part of Fig. 2. A detailed mathematical derivation [8] 
using a reparametrization in the coordinates of the imaginary surface where 
the interaction becomes effective (cf. dotted line in the left part of Fig. 2) 
and a small gradient expansion in h in fact shows that this scenario gives 
simultaneously rise to the two contributions oiV^h and a^M in (11). More- 
over, the coefficients a\ and can be related to the mean deposition flux 
F and the effective range h of the interatomic interaction yielding a\ = -Fb 
and fle = Fb"^ [8]. Although b cannot be directly measured its magnitude 
will be typically of the order of one atomic diameter and, therefore, much 
smaller than the radius of the surface curvature. This implies that the term 
proportional to ae is of minor relevance in comparison to the Oi-term and 
can be neglected. Moreover, the sign of oi is negative. 

The term proportional to 02 can be related to the surface relaxation orig- 
inally suggested by Mullins [13,14]. The basic idea behind this effect (cf. 
aiso the middle part of Fig. 2) is that the deposited particles favor places 
at the surface with positive curvature V^h > 0 since there, the already con- 
densed surface particles create a local environment with higher binding en- 
ergy. Therefore, one expects a diffusion current jm oc V(V^h) leading to the 
term —V -jm = a 2 V^h in (11) with being necessarily negative. This term 
can be interpreted as the result of a surface tension that attempts to minimize 
the area of the surface and, therefore, to smooth the surface morphology. 
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The nonlinear term proportional to 03 arises as a consequence of the ef- 
fect of equilibration of the non-homogeneous concentration c of the deposited 
particles just after arriving at the surface. This effect has originally been sug- 
gested by Villain [15, 16] (cf. also [17]). The deposition flux is basically homo- 
geneous implying that more particles per surface area arrive at places with 
a small or zero modulus of slope V/i than at places being strongly inclined 
with respect to the particle beam, cf. also the right par t of Fig. 2. Therefore, 
the concentration is weighted by the slope, c oc 1/^/1 + leading to 

c oc 1 — in a small gradient expansion. The tendency to equilibrate 

the concentration gives rise to a diffusion current jc oc — Vc oc V(Vh)^, or 
equivalently, to the term — V • jc = a3V^(V/i)^ appearing in (11). It also di- 
rectly follows that the coefficent as is necessarily negative. The following sim- 
ple dimensional argument leads to an estimate for as. Equation (11) implies 
that the coefficient as has the dimension of length^/time. The magnitude of 
03 necessarily depends on the deposition flux F that possesses the dimension 
of length/time and the mean diffusion length I under concentration equili- 
bration which is the only relevant length scale determining this process. The 
simplest combination of F and I leading to the correct dimension of as is FF . 
Therefore, one expects 03 oc ~FP. A detailed discussion of the concentra- 
tion equilibration [8] supports this argument and yields the explicit relation 
as = Moreover, the typical magnitude of I is of the order of several 

atomic diameters. 

As already mentioned in section 2, the physical origin of the nonlinear 
terms proportional to 04 and 05 is determined by the potential variations 
of the coarse-grained density [7,8]. These terms cannot result from particle 
desorption since the substrate is held at room temperature and the parti- 
cle energy in the vapor beam is rather low (typically of the order O.leV). 
Therefore, all arriving particles finally contribute to the surface growth. As 
a consequence, any term that cannot be recast in form of the divergence of a 
current in (11) arises from changes of the coarse-grained density. Assuming 
for the moment that the deposition noise is zero (t] = 0 ), particle conserva- 
tion implies that the rate of change of the number of particles per substrate 
area at a given substrate location, C, is determined by a continuity equation 
dtC = —V ■ jc + PoF. Here the divergence of the current jc is given by 
the combination of all surface relaxation processes (cf. the afore-mentioned 
arguments), i.e. by -V • jc = po[«iV^H -I- as'V'^H + asV^(Vi7)^ + a^M]. 
Allowing for density variations at the growing surface, the rate of change of 
C is related to the rate of change of the height H by dtC = p{VH)dtH. Here 
p{VH) denotes the density at the surface. Without the incorporation of den- 
sity changes (p = po = const.), there is a direct proportionality dtC = podtH. 
If small density variations are taken into account, p(VH) can be expanded 
in the derivatives of H yielding p{VH) = po[l + qi{W H)^ + qs'V'^ H] in lowest 
order approximation. Therefore , dtH = pQ^[l — qi{' 7 H)^—q 2 V‘^H]dtC holds. 
Inserting this in the continuity equation from above, explains the presence 
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of the two terms —qiP^VH)^ = a 4 (V/i)^ and -g 20 i(V^if)^ = a^{V'^hY ap- 
pearing in (11). Prom the physical point of view, however, density changes 
are primarily connected to the gradients of the surface profile reflecting the 
local arrangement of the particles at the surface and not so much to the sur- 
face curvature. Therefore, it is pausible to disregard the term a 5 (V^h)^ in 
a minimal description of the growth evolution. Since the density variations 
result from a widening of the mean inter-particle distances at the surface one 
has to expect that they locally decrease the density implying that 04 > 0 
holds. 

Taking into account the afore-mentioned physical arguments, the terms 
as(V^/i)^ and a^M can be neglected and we finally end up with two minimal 
model equations for amorphous film growth, namely 

dth = aiV^h + a 2 V*h + azV‘^{\/hf +ri (13) 

(fli < 0 for i = 1,2,3) that applies to growth processes with a basically 
homogeneous coarse-grained density and its more general version [7, 8 ] 

dth = m -b + a^V'^iVhf + a 4 {^h)^ + 77 (14) 

(g 4 > 0) for the case that significant density variations occur during the 
growth process. Equations (13) and (14) constitute minimal models for amor- 
phous surface growth in the following sense: They are based on the systematic 
minimal nonlinear functional form (11) of the growth equation, further re- 
duced by taking into account the physical relevance of the various terms in 
(11) and contain the leading order nonlinearities that prevent the surface 
morphology from an exponentially rapid growth in time. 

As a phenomenological ansatz, a growth equation similar to (14) has also 
been discussed in the context of molecular beam epitactic growth of crys- 
talline structures (cf. [2]), albeit with different signs of the coefficients. Most 
significantly, the sign of the coefficient oi (being attributed to desorption 
effects) is then assumed to be positive. This in turn leads to a significantly 
different spatio-temporal evolution of the surface morphology since, in com- 
parison to amorphous surface growth, a growth instability [8] is missing. 

Whether (13) or (14) is the most appropriate minimal growth equation 
for specific amorphous films can also depend on the type of materials used. 
We note, however, that a recent study [7] considering the case of amorphous 
Zr 65 Al 7 , 5 Cu 27.5 films indicates the necessity of incorporating density varia- 
tions - at least for that material. 

4 Some Properties of the Growth Equation 

In the remainder of this contribution, we address one specific point of the 
spatio-temporal evolution of the surface morphology, namely the differences 
of the temporal evolution of the correlation length Rc and the surface rough- 
ness w in (13) and (14). Using stochastic numerical simulations of the surface 
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Fig. 3. Correlation length Rc and surface roughness w calculated from the nonlinear 
growth equation (14) using the parameters oi = — 0.0826nm^/s, U 2 = — 0.319nm^/s, 
03 = — 0.10nm®/s, D = 0.0174nm‘‘/s and various values of 04 : 04 = Onm/s (solid 
lines), 04 = 0.016nm/s (dotted lines), 04 = 0.040nm/s (dashed lines), and 04 = 
0.055nm/s (dash-dotted lines). 



growth equations starting from a flat substrate, we investigate the evolution 
^ Rc and tu as a function of the experimentally measurable layer thickness 
H. This quantity is determined hy H = {{H{x,t))r,)x = Ft + {{h{x,t))r,)x 
and, is, in general, implicitly connected to the time t via the solution of (14). 
For the special case (13), however, H is directly given by the product of the 
mean deposition flux and the time, i.e. Ft, since there is no excess velocity. 

For the specific example of the growth of Zr 65 Al 7 . 5 Cu 27.5 films [4-7], a 
parameter estimation procedure discussed in detail in [7] yields for the coeffi- 
cients in (14) oi = -0.0826nmVs, 02 = -0.319nm^/s, 03 = -0.10nm®/s, 
and 04 = 0.055nm/s and for the strength of the deposition noise D = 
0.0174nm^/s. For these values, a basically perfect agreement between exper- 
imental and simulation results has been obtained [7]. The dash-dotted lines 
in Fig. 3 correspond to this choice of the coefficents. Lowering the coefficient 
04 that determines the strength of the density variations during the growth 
process to zero reveals the following: 

(i) Setting 04 equals zero (solid line), the correlation length Rc initially in- 
creases proportional to a power law. This reflects the growth behavior in 
the time range where the linear terms in (13) are dominant and the nonlinear 
term is not yet excited due to the smallness of h. In contrast to the linearized 
form of (13) that leads to a constant value Rc oc 4 / 202/04 for large times, the 
nonlinear term in (13) significantly contributes to the spatio-temporal evolu- 
tion of h{x, t) and yields a further increase of Rc with the time t. For nonzero 
04 in (14), the_dependence of Rc on the layer thickness agrees with the case 
04 = 0 up to if = 120nm. Beyond this layer thickness, the correlation length 
Rc first increases slightly stronger than in the case 04 = 0. For even larger 
layer thicknesses, a maximum of Rc is reached with a subsequent decrease of 
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Re- This behavior can already be observed for 04 = 0.040nm/s (dashed line) 
and is even more pronounced for 04 = 0.055nm/s (dash-dotted line). As an 
aside, we note that Rc levels off again for layer thicknesses much larger than 
500nm. As a consequence, the inclusion of density variations in the growth 
equation (14) significantly changes the typical length scale over which height 
fluctuations are correlated. Including density variations, the correlation length 
Rc varies non-monotonically with layer thickness. 

(ii) Setting again a4 equals zero (solid line), the surface roughness w ini- 
tially increases exponentially. This again reflects the growth behavior in the 
time range where the linear terms in (13) axe dominant and is therefore basi- 
cally determined by the most unstable wave number of the linearized growth 
equation. For larger times, when the nonhnear term in (13) has a significant 
influence on the spatio-temporal evolution of h{x, t), this increase crosses over 
to a power law, w cc t [8]. For nonzero 04 in (14), the dependence of w on the 
layer thickness agrees with the case «4 = 0 up to if = 300nm. Beyond this 
layer thickness, the surface roughness w increases significantly weaker than in 
the case with 04 = 0. More importantly, also the curvature of w changes with 
the layer thickness. This behavior can be clearly observed for 04 = 0.040nm/s 
(dashed line) and is even more pronounced for 04 = 0.055nm/s (dash-dotted 
line). As a consequence, the inclusion of density variations in the growth 
equation (14) primarily changes the curvature of the evolution of the surface 
roughness which leads to a strongly delayed increase, or even to a saturation 
of w. 

(iii) Comparing the results for Rc and w, one infers that the impact of 
density variations shows evidence in the correlation length Rc at much earlier 
Staggs of the growth process than in the surface roughness w. 

5 Conclusion 

In this contribution, we have systematically derived the minimal functional 
form of a growth equation appropriate for the understanding of amorphous 
thin film growth, cf. equation (11). We have also related the terms occuring in 
the functional form (11) to underlying microscopic surface relaxation mecha- 
nisms and presented some results on the temporal evolution of the correlation 
length and the surface roughness of the corresponding surface morphology. 
Finally we showed that the incorporation of density variations of the growing 
material significantly reduces the surface roughness. 
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Abstract. Heteroepitaxial growth of clusters in presence of elastic strain has been 
studied by means of a multi-grid Monte Carlo simulation. Deformation of the under- 
lying substrate typically leads to a repulsive 1/r® interaction-potential between the 
adsorbed atoms. We find an increased effective fractal dimension d; on small scales, 
exhibiting a crossover to the conventional dimension of diffusion limited aggrega- 
tion (DLA) on large scales. The growth velocity of an advancing fractal step grown 
from a lattice gas of finite density is shown to reflect this crossover phenomenon 
as the velocity is linked to the fractal dimension of the aggregate. We show that 
matching of length-scales holds as a mechanism of velocity selection. Starting with 
a smooth coverage, our microscopic model of 2 -f 1-dimensional cluster growth is 
subject to a Grinfeld instability and ends up with coarsening island configurations. 



1 Introduction 

Epitaxial growth is a process of great interest in crystal-growth [1-3] and 
for the manufacturing of semiconductor-devices. Heteroepitaxy puts forth a 
variety of growth morphologies originating from the effects of elastic strain. 
Low deposition rates combined with sufficiently low surface diffusivity - and 
in particular edge diffusivity - lead to the formation of monatomic ramified 
clusters as long as the coverage remains small. This process has been studied 
in great detail under the name “diffusion limited aggregation” (DLA) [4]. 
While DLA-clusters grow by successive diffusion and aggregation of single ad- 
atoms, our multi-particle growth model based on [5] allows for the interaction 
and diffusion of many ad-atoms at a time and models an advancing fractal 
step on the substrate. 

In heteroepitaxial growth the lattice mismatch between the adsorbed lay- 
ers and a substrate of different material in general leads to elastic deformation 
of the substrate lattice. A single adsorbed cluster up to some limiting size 
will acquire the lattice structure of the substrate apart from a small local 
change in the lattice parameter. This “coherent” lattice deformation causes 
elastic stresses in both the adsorbate and the substrate, leading to effective 
long-range interactions between the adsorbate atoms mediated by substrate- 
deformations. This effective elastic interaction potential between any two 
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adsorbed atoms is typically repulsive and depends on their distance r like 
1/r® [6-9]. The total interaction energy in an adsorbed cluster is then ob- 
tained by summation of the individual contributions from any two pairs of 
atoms as long as the cluster remains coherent with the substrate. 

A number of recent investigations have looked at DLA with interactions 
[10,11]. Some investigations even deal with long-range interactions [12-14] 
of the type discussed here, but we are not aware of attempts to understand 
the asymptotic behavior of the structures for large cluster sizes. It was found 
[5] that the properties of the growing cluster change when the radius ex- 
ceeds a critical radius rx . This crossover-radius depends on the strength and 
the range of interaction, but remains finite even for the long-range elastic 
interaction without cutoff. 

2 Scaling Theory for DLA-Clusters 
with Elastic Interaction 



When the l/r^ interaction is repulsive, as is usually the case for elastic forces 
mediated over the substrate, the resulting overall fractal clusters look gener- 
ally denser than clusters without long-range repulsive interaction, see Fig. 1. 
The structure of the clusters can be characterized by an increase in the effec- 
tive fractal dimension deff > 1-7 on short length-scales exhibiting a change 
[5] to conventional DLA-structure without interaction df ss 1,7 [15,16] at 
a crossover-length rx. With artificial attractive interaction the clusters look 
much more feathery or thinner than for conventional DLA, which can be 
related to a lower effective fractal dimension deff < 1.7. 

The qualitative effect of a repulsive interaction between the diffusing par- 
ticle and the cluster generating a new length-scale can be understood as 
follows. Feeling the repulsion of the tips of the cluster, a diffusing particle 
will enter a deep bay-like opening or Qord with increased probability. Having 
entered, the particle will diffuse the length 

rx «rwexp^i[//Tj (1) 

along the fjord before being captured by one of the walls. In (1) tj = CqUq (1- 
1/ro) is the potential barrier with Cq w 3.3, and r„ is the characteristic width 
of the fjord, see [5] for details. As a result, the crossover length rx can be 
understood as a kind of mean penetration depth. 

3 Multi-particle Growth 

The major goal of our multi-particle diffusion simulation is to analyze the 
impact of elastic effects on real diffusive growth. On the basis of M. Uwaha’s 
and Y. Salto’s model [17] we study the steady state properties of a cluster 
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Fig. 1. Cluster of 2 x lO® particles grown by a DLA-process. There is a repulsive 
elastic l/r®-interaction between each two particles, the relative interaction-strength 
being Uo/T = 2.0. The size of the cluster is approximately 1600® lattice units 



growing inside a channel of width L with periodic boundary conditions per- 
pendicular to the direction of growth. Far away from the growth front the 
lattice gas density rig is kept constant. The underlying physics is that for 
stationary growth the diffusion field in front of a flat interface relaxes expo- 
nentially within a diffusion length 1. A length-scale matching hypothesis [17] 
then leads to a scaling prediction for the growth velocity. 

Our study is based on a two dimensional square lattice with gas atoms 
performing a biased random walk until they move next to a cluster atom 
and are added irreversibly to the cluster. Colliding gas atoms do not form 
new cluster seeds. On average each gas atom performs a diffusion jump trial 
once per time-step. In each diffusion jump one of the four neighboring sites is 
chosen with equal probability and accepted with a probability according to 
the metropolis algorithm. Presuming a mono-layer system, gas atoms have 
to be treated as hard spheres in the sense that lattice sites can be occupied 
by only one atom at a time. 

For vanishing particle density Ug ^ 0 the motion of the gas atoms is 
equivalent to diffusion in an external field. In the high density limit the 
atoms have no room to move and cluster aggregation is equivalent to the 
Eden model independent of interaction. At a constant distance ahead of the 
most advanced point of the aggregate the gas density is kept constant. This 
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Fig. 2. Layers grown from lattice gas with density ng = 0.3. The interaction 
strengths axe from left to right Uo/T = 0, (/o/T = 2 and UojT = A 



is realized by adjusting the number of gas atoms within a box far from the 
cluster to the default value rig at the beginning of each time-step. Since the gas 
density is assumed to relax exponentially from the growth front to its limiting 
value, it is sufficient to locate this box at a multiple of the estimated diffusion 
length away from the cluster. We did simulations with width L = 1024 lattice 
units for small densities and L = 512 for high densities. The height of the 
aggregates grown ranges from 3500 to 8000 lattice units. 

Starting with a single cluster-line at the bottom and randomly distributed 
lattice gas, the cluster begins to grow, and a depletion layer evolves in front of 
the cluster. The cluster has a ramified branch like structure, which is similar 
to clusters grown by conventional DLA on small length-scales. The density- 
density-correlation function shows power-law decay, which can be related to 
an effective fractal dimension df. We will ask how the change in the effective 
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fractal dimension due to elastic effects enters into the structure of multi- 
particle growth, and how it influences the growth rates of the aggregates. 

4 Structures 

If we compare the clusters grown with different repulsion strength, we see 
that the overall structure looks denser with increasing strength. This is ex- 
actly what one would expect from observations made on DLA with elastic 
interaction [5]. For a sufficiently low gas density the aggregate is correlated 
up to a characteristic length ^s, whereas particles separated more than the 
characteristic length are uncorrelated. This length increases with both in- 
creasing interaction strength and lower densities. Note that all clusters in 
Fig. 2 have the same overall density. One can easily see the increasing char- 
acteristic length with rising interaction strength. 

From the power-law behavior of the density correlations we obtain that 
the effective fractal dimension rises from df « 1.7 for l7o/T = 0 and df w 1.84 
for UolT = 2 up to d( fs 1.95 for Uq/T = 4. These values are consistent with 
our DLA simulation with the same interaction. 

For comparison without an immediate physical reason we have also looked 
at the related problem of attractive interaction. In this case an initially ho- 
mogeneous gas distribution tends to form drops with a surrounding field of 
diffusing particles. In contrast to the case with repulsive interaction, where 
we exclude the nucleation of clusters not connected to the advancing front, 
the attractive interaction in the present case tends to produce clusters on 
free space immediately, similar to the condensation of stars in galaxies on as- 
tronomical scales. The drop population ripens and the drops become bigger, 
while their number decreases. Although their mobility is strongly hampered, 
the particles are not irreversibly bound until the drops come into contact with 
the cluster and are incorporated into it quite rapidly. The size of the drops 
depends on the characteristic time r it takes the front to reach a growing 
drop. Being deposited a distance d away from the interface, the drop popula- 
tion ripens during a characteristic time t, which depends on the velocity V of 
the interface like r = d/V. Prom standard Ostwald ripening arguments the 
radius of the drops should behave like R ^ which seems to hold quite 
well. An example can be seen in Fig. 3. The attractive case is in some sense 
academic because isotropic elastic interaction in general has repulsive char- 
acter. If not written explicitly, we will from now on be dealing with repulsive 
interaction. 

5 Growth Velocity 

After the growth process reaches its steady state, the number of solid atoms 
in the aggregate is linear in time, and since the properties of the interface 
remain unchanged, its velocity V is simply proportional to the number ANs 
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Fig. 3. Three growing clusters of width L = 256 lattice units with droplets also 
forming in the gas phase at interaction strength Ua/T = —1, density ng = 0.2. 
Deposition distance d h^ls values d = 64, 128 and 256 



of atoms incorporated to the aggregate during the interval At. Hence V can 
be defined by 



V = 



AN, 
n^LAt ’ 



( 2 ) 



where L is the width of the channel in lattice units. With increasing interac- 
tion strength the velocity strongly decreases which can be seen in Fig. 4. This 
agrees with the expectations from first intuition. Particles have to overcome 
a barrier to reach the cluster. Only the high density limit is independent of 
interaction. The model is designed to show a crossover to the Eden model 
[18]. The particles have no room to move, and aggregation is controlled by 
interface kinetics. Note that due to the choice of the time increment the abso- 
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Fig. 4. Velocity of growth V vs. gas density rig. The curves represent different 
interaction strength: (a) without interaction, (b) to (d) with Uo/T = 2, Uo/T = 3 
and Uo/T = 4 



lute velocity values differ by a factor of 1/4 from the values given by Uwaha 
and Saito [17]. 

In the case of ng = 0.5 a simple explanation for the dependence of the 
growth velocity on the interaction strength can be found valid for Uo/T > 2. 
Consider all gas atoms arranged in the ground state, which is a checkerboard 
like ’structure. In order to solidify a gas atom has to overcome an energy 
barrier in the order of a thermal activation in the checkerboard structure, 
which is AE « 0.92{7o- Hence the velocity controlled by thermal activation 
is proportional to exp(— 0.9217o/T')- 

6 Effective Diffusion Constant 

For the measurement of the effective diffusion constant, a simulation of the 
multi-particle diffusion process at gas density rig was done in absence of a 
cluster but with the same kinetics as described above. Taking the position 
of a gas atom r{t) at time t, the autocorrelation reads ((r(f) — r(0))^) = 
2nD ■ t for diffusion in n dimensions. For our purpose the limit t — ^ oo 
of {{r{t) — r{0))^)/{2nt) is a reasonable definition for the effective diffusion 
constant Des(ng)- In. the limit of vanishing density the quantity Heff should 
obtain the value D = 1/4. In the limit rig -> 1 the gas atoms become immo- 
bile and Deff 0. As shown in Fig. 5 the defined effective diffusion constant 
meets the given requirements. With increasing interaction strength the atoms 
become more and more limited by the effective potential due to the surround- 
ing particles, and their mobility decreases. The energetically most favorable 
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Fig. 5. Effective diffusion constant Des calculated from autocorrelation without 
interaction (a), strength Uo/T — 1,2,3 and 4 in curves (b) to (e) 



State is restricted by the discreteness of the lattice. With gas density rig = 0.5 
and nonzero repulsive interaction the lattice gas organizes in a checkerboard 
structure with deviations only due to thermal activation. This explains why 
the effective diffusion constant shows such a strong minimum at rig = 0.5 for 
interaction strength Uq /T = 4. 

We will see that the density dependence of the diffusion constant may not 
be neglected in the interacting case, and that contributions due to D should 
be included into the scaling relation for the velocity V. 



7 Scaling Analysis for Multi-particle Growth 

Due to the stationarity of growth the overall cluster density will match the 
given gas concentration because material is conserved. Hence the structure of 
the cluster cannot remain fractal on large length-scales. Particles finally be- 
come uncorrelated, and the correlation function approaches an equivalent to 
the average density value. This crossover defines a new length-scale, the char- 
acteristic length of the cluster. If one assumes a simple power-law decay of 

the correlation function c{r) ~ for the range where the fractal dimen- 
sion rules the structure of the cluster and c(r -t oo) ~ rig for greater dis- 
tances, these two asymptotic laws define the crossover length ~ 

Assuming for the moment that the diffusion coefficient D does not depend 
on the density, we can define a diffusion length I ~ D/V, where V is the 
characteristic velocity of the advancing front. Relating the diffusion length 
I to the characteristic length-scale of the cluster one obtains the same 
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Fig. 6. Scaled velocity V j Dett{ng) for interactions Uq/T = 0, 1,2 and 4, curves (a) 
to (d) 

scaling relation V ~ as found by Uwaha and Saito for the non- 

interacting case. Looking at Fig. 5 we see that the density dependence of 
the diffusion constant cannot be neglected in the interacting case and that 
contributions due to the changes of Deft have to be included into a proper 
scaling relation for the velocity V. 

Starting with simple non-interacting particles, we argue that from a macro- 
scopic point of view the exponential relaxation of the density in the depletion 
layer remains unchanged. Far away from the interface the relaxation of the 
diffusion field can still be characterized by a macroscopic diffusion length 
I ~ Deff/V. If other length-scales do not exist or can be neglected, I becomes 
the characteristic length of the lattice gas. We extend the above argu- 
mentation and end up with the prediction that a scaled velocity V/Dcs{ng) 
should vary like 

VIDeffin^) ~ (3) 

if the cluster can be characterized by a single fractal dimension. Having in 
mind that the effective fractal dimension might change under a change of 
scale, one should be able to observe a change in the exponent in (3). 

Ignoring the nonzero width of the crossover region, the correlation func- 
tion measured should look like the correlation function evaluated in DLA 
with the minimum limited by a value corresponding to the average particle 
density. In this picture the density rig corresponds uniquely to a correlation 
length given by the inverse DLA correlation function. Depending on the 
relevant crossover regime, behaves like ~ with d{ being either 

the fractal dimension of DLA or the increased effective dimension found in 
the presence of elastic effects. 
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Fig. 7. Height of islands evolved from smooth coverage by one mono-layer. Snap- 
shots were taken when the total energy was decreased by 1%. The length-scale on 
which clusters have developed is just above the critical cluster size. Ratio of elastic 
interaction strength to bond energy t/o/l/bond is 0.125 for left and 0.075 for right 
configuration 



Detailed investigation of the lattice gas leads to the insight that near 
rig = 0.5 the gas becomes correlated as well, and the correlation length of the 
gas is in competition with the diffusion length. The rather drastic increase in 
correlation at this density value can be understood as some kind of resonance 
effect. However, for interaction strength Uq/T <3 the scope of correlations 
in the gas is still of the order of unity and can be ignored. Yet for Uo/T = 4 
this length becomes relevant and is the cause for the irregular behavior of 
curve (d) in Fig. 6. Starting with a fairly high density value of rig « 1/2, the 
slope of the curves increases with the interaction strength in correspondence 
to the effective fractal dimension approaching the value df = 2 in the DLA 
simulation. In this regime the growth velocity can be characterized by an 
increased effective fractal dimension. Lowering the particle density the slope 
decreases as well, bounded by the slope of the non-interacting case (a). For 
relatively weak interaction (b) it is obvious that the slope converges to the 
value of (a), indicating that in the low density limit the velocity of growth is 
governed only by the fractal dimension of simple DLA df w 1.7. 

The results indicate that the matching of characteristic length-scales sur- 
vives as a valid mechanism of velocity selection in presence of elastic effects. 
The crossover in fractal dimension found in our DLA simulation is shown to 
have a strong influence on the properties of fractal growth. In the low density 
limit, however, the velocity of growth is controlled by the fractal dimension 
of DLA only. 



8 Multilayers 

We tried to generalize the 1/r^ elastic interaction-potential to higher layers 
above the substrate. For two particles at height hi and /12 above the first 
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mono-layer we use the interaction potential 



(4) 



where r is the distance of the particles projected onto the substrate plain, 
and the relaxation parameter b is set to be equal to the average diameter 
of epitaxially adsorbed clusters. This formula (4) should be taken only as 
a mean-field approximation of the interaction of particles accumulated in 
clusters. We think, however, that it captures some basic ingredients of the 
interaction, and it has the advantage that the computation of the formula 
is very fast with our multi-grid-scheme. Our model-potential (4) allows for 
elastic relaxation on higher layers of an island and reproduces the 1/r^ inter- 
action in the first mono-layer. The total elastic energy of a cluster saturates 
with increasing height, and the elastic interaction of particles on higher layers 
decays exponentially within the width of the islands. The width b is treated as 
a mean-field value. In absence of elastic effects the next-neighbor-bond energy 
favors a flat interface, corresponding to layer-by-layer growth. With increasing 
elastic interaction island growth becomes more favorable than layer-by-layer 
growth. 

Analogous to the analytical treatment of the Grinfeld instability we expect 
a smooth coverage to be stable under perturbation on small wavelengths 
and unstable under big wavelengths. Islands have to exceed a critical size 
depending on the ratio of competing energy terms to be more favorable than 
a flat layer. Figure 7 shows configurations resulting from two simulations 
shortly after islands of critical size have evolved. The configurations shown 
are transitional in the sense that the islands are subject to a coarsening 
process. The height of an island is not limited by its width and clusters can 
in principle grow arbitrarily high. Optimizing the shape of cm island with 
fixed volume we see that an increase in volume will always be favorable. 
Hence there is no stable island size. Stability can only be achieved if the 
cluster height is related to its width which is the case for a pyramid-like 
shape where the total energy exhibits a minimum as a function of the cluster 
size. 



9 Conclusion 

In summary, we have studied the growth of fractal adsorbate clusters growing 
by both a DLA-process and a multi-particle-diffusion algorithm with effective 
long-range elastic 1/r^ -interaction between the adsorbate atoms. The results 
are interpreted by scaling relations like (3). The effective fractal structure of 
the clusters is found to exhibit a crossover at some length-scale r\ depending 
exponentially on the strength of the elastic 1/r^ -interaction between the ad- 
sorbate atoms. On scales greater than rx DLA-clusters show the same fractal 
dimension of about df « 1.7 as observed in conventional DLA. On smaller 
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scales the effective fractal dimension of the cluster seems to be increasing to- 
wards the value of df = 2 for increasing repulsive interaction, and decreasing 
smoothly towards df « 1.5 for increasing attractive 1/r^ interaction. Repul- 
sive elastic interaction leads to a decrease of the velocity of growth. While 
in the low density limit the velocity differs in factor only, with increasing 
density the scaling exponents change systematically due to the crossover in 
the effective fractal dimension. Our results indicate that for practical ap- 
plications e.g. in molecular beam epitaxy (MBE) the cluster-properties will 
depend in a rather sensitive way upon the lattice mismatch between adsor- 
bate and substrate since this directly affects the interaction-parameter, which 
enters exponentially into the crossover-radius. 
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Abstract. This study reports on simple numerical observations as well as qualita- 
tive extensions of the stochastic kinetics of a discrete line-model. Some comparative 
analysis of the line’s evolution in square as well as triangular lattices will be given. 
Applications of the modelling to many different areas of physics and chemistry are 
sketched. 



1 Introduction with a Motto 

Let us start with a statement taken from a book by Stauffer and Stanley [1]: 
“It requires nature millions of years to form a coastline, but you can do it in 
less than a minute” . 

A short story that we are going to tell the reader is about, how to form 
a quite real coastline, with peninsulas, bays, small (contiguous) islands, etc. 
(see Fig. 1), which will survive for a sufficiently long simulation time, and 
which will eventually disappear because a hard competition of disappearance 
as well as appearance events can take the system into this one-way state: 
The disappearance of the line as a whole. (In reality, a coastline may also 
disappear into water because of a flood.) 

The leading sentence of this section (cf., a description of the diskette at- 
tached to [1]) includes implicitly an indication of “an almighty power”, which 
is able to reproduce “natural forms” in a very short time period. As we know, 
such a power, being one of the most important landmarks of technological 
progress is the computer, that means a device which is specially suited for 
performing simulations of physical phenomena, e.g. natural hazards and land- 
forms, viz. self-affine objects [2]. Also our study relies on (and exhibits!) the 
mightiness of computer. 

This work is in a certain way a continuation of one of our previous studies 
[3], about the evolution of a line (or interface) in a two-dimensional discrete 
space, a topic possibly of importance for many nonequilibrium phenomena, 
like (poly) crystallization and phase separation [1,4], phase transitions [5], 
thin film formation and random surface growth [6,7]. These phenomena do 
not exhaust the whole list of possible applications of modelling, e.g. in solid 
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state physics (towards elementary excitations of matter) and/or polymer sci- 
ence (due to formation of heteropolymers). 

The paper is organized as follows. In the next section we give a brief 
description of the algorithm. In the remaining three sections we offer some 
preliminary results of numerical studies, then we report on useful extensions 
as well as applications of the modelling, and finally arrive at a few conclusions, 
featuring the present study. 




Fig. 1. The cartoon of a “real” coastline taken from our computer simulation 



2 Brief Description of the Algorithm 

Apart from the boundary conditions, the algorithm is the same as presented 
in [3]. Before the explanation of the details a few snapshots of an evolving 
system may provide a quick overview: 




Fig. 2. Example of the evolution of a smcill system - The small arrows indicate the 
accidental movement of a line’s unit, whereas the big ones point to the resulting 
configuration of the discrete line. Rules No^. 1, 3 and again 1 (this time subjected 
to the boundary conditions) have already been applied, from left to the right. 
(Concerning the Rules cf. the next paragraph.) Rule No. 1 is going to be applied 
once more in the last snapshot. 



The process takes place on a square lattice, where the line evolves step- 
wise. The line is formed by occupied bonds which we call X-units (horizontal 
bonds) and F-units (vertical bonds). The initial configuration is a straight 
line made of F-units in the middle of the lattice. 

Every step of the evolution has the same form: 
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• Select at random an X- or a F-unit 

• Choose at random the direction of shifting of X or F (perpendicular to 
its orientation) 

• Look at the place into which the unit has to be shifted (one lattice- 
constant away) , and at the two relevant nearest-neighbouring places, per- 
pendicular to it 

• Follow the corresponding transition rule (cf., rules No®. 1-5 below) 

We define our timescale by the number of steps, in our simulations the evo- 
lution was performed until the line has disappeared (cf. Chapter 3.1). 

The transition rules are isotropic with regard to the lattice axes and fall 
into five types. (Here a H-unit is shifted to the right.) 




2 : 

3: 

4: 

5: 

Fig. 3. The five transition rules for the square lattice 
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• • 
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— > 

• ♦ 


loss of 4 units 



A short summary of the transition rules may be appropriate: The chosen 
unit, the “destination-place”, and the two neighbouring bonds assigned to 
it, are simply inverted with regard of the occupancy. If the destination is 
occupied, we call the rule irreversible, because a back reaction by shifting 
the same unit again is not possible. (Both units vanish, so that the notion of 
“shift” actually does not fit.) Nevertheless the third transition is reversible 
(see remarks on indirect reversibility in [3]). A possible back reaction for the 
fourth rule already appeared in the first transition. 

Regarding the boundary conditions, the algorithm applied in this work 
differs from that in [3] where the periodic boundary conditions (BCs) were 
used. In the present study the boundary conditions are more realistic if the 
finiteness (or, lattice’s border effect!) of the simulation space cannot be ne- 
glected, which holds especially for smaller lattices. We term this kind of BCs 
as weakly reflecting BCs. The evolving line expresses some inelastic collision 
while touching the lattice’s border with one of its elementary units: Once a 
single unit {X or Y) touches the border it is deleted. This can produce two 
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more pinning points of the front, i.e. a self-separation of the line while acting 
on the border. 

3 Numerical Results 

3.1 Simple Observations on the Temporal Behaviour of the Line 

One may get a superficial outlook that the annihilation rules, (those which 
cause a loss of units,) are always in favour in the course of the whole process, 
because they are on the majority (cf. Fig.3). It is probably an oversimplified 
impression, because in the beginning, and also quite apart of it, the creative 
as well as neutral rules are allowed to be selected more frequently because 
of being favoured by the current configuration. However, assuming that the 
system is ergodic, it is expected that for sufficiently long runs the overall line 
will disappear. 

We carry out simulations on square lattices of both even as well as odd 
linear sizes. This means that the initial line consists either of an even or an 
odd number of elementary F-units constituting the line, but further we do 
not care about whether this same overall line preserves its parity or not. We 
simply carry the simulation until the line disappears totally. The goal of our 
study is then to understand certain characteristics of this phenomenon. 

The most important physical quantity that we are able to extract from 
this computer experiment is the mean disappearance time T^s, where the 
arithmetic mean is always taken over 50 simulations for each lattice of size 
/, where I is chosen to be 2”, with “interpolating values” of 3 x 2"“^ for 
n = 2,3, 4, 5,6 (even values), and where in turn I is assumed to be 1 + 2", 
with 1 + 3 X 2"“^, i.e. for odd values. 

As we mentioned above the BCs for this evolution are not periodic [3], 
but can be considered as weakly reflecting. The reflection is weak because the 
collision with the lattice borders by the line can be regarded as inelastic. The 
number of touches is designated by During a single touch some lateral 
subfront, a part of the global front (line), may emerge. 

In addition to this lattice border-induced phenomenon there is also a 
creation of subfronts in the bulk phase, without involvement of the lattice 
borders. Because of Rule No. 3 mainly (it could, however, be emphasized 
that all the remaining rules, probably except the creative Rule No. 1, can 
also afford the same separation or re-separation effects) producing subfronts 
of this type, one can in a rather naive way introduce a quantity standing for 
the self-separation of the line in the bulk phase: the number of calls of the 
third rule, designed by Ncsf- 

Our investigations are completed by the calculation of the standard de- 
viation of Tdis, SD{Tdis)- (We do not assign any special physical meaning to 
SD{Tdis).) 

The main results of this section can be presented in a tabular form. 
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Table 1. Critical exponents of the main chciracteristics of the line’s evolution pro- 
cess obtained from a linear regression analysis of the log — log plots of the basic 
quantities measured in the simulation (first row: for the square lattice of even linear 
size; second row: for the lattice of odd linear size). The average confidence level of 
the presented results is about 99.5 percent. 



1 vs. Tdis 


1 vs. SD{Tdis) 


^Isf VS. Tfiis 


Ncsf vs. Tdis'^ 


0.25 


0.25 


0.70 


1.01 


0.26 


0.26 


0.69 


1.01 



Nisf is the number of collisions of the lattice borders by the evolving line, causing 
the removal of the unit landing on the border. Moreover, another “non-kinetic” 
characteristics have been obtained, namely I oc with ui w 0.36, which holds 

for both lattices. 

Ncsf, the number of applications of Rule No. 3 is assumed to be a measure of 
self-separation of the line aside of the lattice borders. It has been obtained that 
I oc with Uc w 0.25 holds for both even as well as odd lattices. 



From the computer experiment it follows that the values of Tug and SD{Tdis) 
increase monotonically and (almost) in the same way with 1. Looking at the 
competitive behaviour of iV/s/ and Ncsf one may observe that for smaller 
lattices Nigf take on larger values, but around a certain value of I the sit- 
uation changes apparently, and further Ncsf win in such a competition. No 
doubt that this would imply that for larger lattices the lattice border effect 
diminishes. The same quantities are measured for the lattices of odd linear 
size. We obtained quantitatively as well as qualitatively very similar results 
so that the conclusions coming from the simulation carried out for the even 
lattice can be extended to this case as well. Thus, as anticipated intuitively 
no essential difference between the two cases presented was noticed. 

Looking at the exponents presented in Table 1, one can have a firm quan- 
titative confirmation of the qualitative description given above. Namely, the 
critical (or scaling) exponents [1,7] have been picked up using the linear re- 
gression method applied to log — log characteristics mentioned therein, which 
are observed to be in a power form, cf. [1-3,8], Above all, an apparent ac- 
cordance of the values presented for both even and odd linear sizes of the 
lattices has been revealed. Prom the last column of Table 1 it can be inferred 
that a direct (approximately linear) proportionality between Ncsf and Tdis 
is manifested, which is felt as a natural (common sense) result, reflecting our 
intuition about this subject. Let us notice by inspecting Nisf vs. Tdi$ charac- 
teristics that this is rather not the same case as the preceding one, since the 
exponent is about 0.7 (but not equal to one). Probably the physically most 
interesting fact can be anticipated if one looks into the first two columns of 
Table 1. Despite that good accordance of the exponents, one can also realize 
their values. Their, let us say, common value is about which may char- 
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acterize a very slow (subdiffusive) process [1,5], where the slowing down is 
owing to the long-lasting competition of the annihilation-creation (chemical) 
rules. The approximate relation (we have rounded all the values in our tables 
up to second decimal point, underscoring a rather preliminary character of 
our numerical results) is the following: 



I* ~ Tdis ( 1 ) 

In other words, such a kinetic obstacle (presence of both the annihilation as 
well as creation rules) is going to introduce a certain notion of third and even 
fourth dimension into the described process. 



Table 2. Critical exponents of the main characteristics of the line’s evolution pro- 
cess obtained from a linear regression analysis of the log — log plots of the basic 
quantities measured in the simulation (first row: for the square lattice of even lin- 
ear size; second row: for the lattice of odd linear size), but with a modification in 
the main algorithm: Not a unit is selected by equal chances, but an elementary 
sub-configuration, which is one of the quadratic configurations, shown in Fig. 3. 
Then one choose randomly a vertical or horizontal X- or T-unit belonging to it, 
simultaneously with its direction of shifting (which can be inwards or outwards this 
sub-configuration). The average confidence level of the presented results is about 
98 percent. 



1 vs. Tdu 


1 vs. SD{Tdis) 


VS. Tdis 


I^csf vs. Tdia 


0.32 


0.34 


0.71 


0.98 


0.33 


0.34 


0.73 


1.00 



^ Nisf is the number of collisions of the lattice borders by the evolving line causing 
the removal of the unit landing on the border. Prom the simulations it also follows 
that I oc with ui w 0.45 holds for both even as well as odd lattices. 

^ Ncsf, the number of applications of Rule No. 3 is assumed to be a measure of 
self-separation of the line aside of the lattice borders. Prom the simulations follow 
further that I oc with Uc « 0.33 holds for both lattices. 



In Table 2 one sees the results obtained by exploring a (slightly) different 
algorithm (cf. Table 2). The critical exponents [7] have been picked up as- 
suming that the main characteristics are of a power form, cf. [1, 2, 8]. First of 
all, there is excellent accord between the values presented for both even and 
odd linear sizes of the lattices. The last column of Table 2 suggests a nearly 
linear proportionality between iVc»/ and Tdis, which can again be recognized 
as an expected result. Let us mention that for Nuf vs. T^is characteristics it 
is rather not the same case, since the exponent is slightly above 0.7. Probably 
the physically most interesting fact can be noticed if one considers the first 
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two columns of Table 2. All exponents are about and may also characterize 
a subdiffusive process [1,5], where the slowing down is subject to the presence 
of the annihilation-creation (chemical) rules, but realized in a different way 
than before. Another interpretation of such a temporal behaviour would be 
that because of, the chemical reactions present in the system, a relation like 

~ Taia ( 2 ) 

would approximately hold, which means that the presence of those rather 
elementary reactions makes the process as it took place in a cube of edge I 
rather than in the square (lattice) of this same linear size. Loosely speak- 
ing, such a kinetic obstacle is going to introduce a certain notion of third 
dimension into the described process (such a qualitative change of the crit- 
ical behaviour seems to be exclusively due to a seemingly subtle change of 
the first two parts of the evolution-step in the algorithm, see Table 2). By 
the way, the process can be classified to be a diffusion process controlled 
by chemical reaction(s), but not vice versa. Notice that a pure diffusion in a 
form of the random walk of the line, or of the elementary units, composing the 
discrete line, would be manifested if the elementary units, chosen at random 
with equal probabilities, were pushed into their perpendicular directions with 
no restrictions superimposed on the system as a whole, i.e. when no move 
would be forbidden. This situation can be compared, e.g. with that in a study 
[8], in which such a value of the exponent was also revealed for a growing 
process, in which a self-avoiding trajectory appears. This is also the growth 
exponent characteristic of the Kardar-Parisi-Zhang (KPZ) system, e.g. of a 
rough interface [3, 6, 7]. 

In order to discuss the influences of the finiteness of the lattice, one can 
attempt to use the data available from the simulation, e.g. by calculating the 
ratio 2 ^- For small lattices it is of the order of about 10 percent, but for 
the bigger ones it is around 1 percent or less, so that the influence can be of 
a finite but rather quite small magnitude. 

3.2 Comparison of the Disappearance Statistics on the Square 
and Triangular Lattices 

We have investigated Tdis and Nuf also for the triangular lattice, using the 
same alghorithm and the same BCs as for the square lattice, cf. algorithm 
presented in Section 2. In this case Ncsf does not occur, because there is no 
rule that corresponds to the Rule No. 3 in the square lattice. In a triangular 
lattice three types of units appear. We call them X-, Y- and Z-units. The 
initial line consists of I vertical Y s, and I characterizes the quadratic lattice 
area: also its horizontal width is given by I possible units, with X and Z 
alternating zigzag-like. After a unit X {Y-,Z) and a direction being chosen, 
the motion of the line is determined by the (nearest) vicinity: a possible Y 
(X,Z) and a possible Z (X,Y)- 
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In a straightforward relation to the situation on the square lattice the 
rules can be summarized as an inversion (in regard of occupancy) of the 
triangle formed by the selected unit and the two possible neighbours placed 
in the chosen direction. Four rules constitute the entire set of rules. 



. [. - 


- > 


gain of 1 unit 


2: - 


• 


loss of 1 unit 


3: — 


• 


loss of 1 unit 


4: ^ - 


• 

-> 

• 


loss of 3 units 



Fig. 4. Transition rules for the triangular choosing lattice 



Although the values of the standard deviation of Tdis and Nuf for the 
triangular lattice are still larger than the values for the square lattice (e.g. 
SD(Tdu)/Tdu 0-8), the logarithm of the values fit very well to a straight 
line, being always within a confidence level of about 99.5 percent, i.e. better 
than in the case presented in Table 2. Additionally, one has to remark that 
(at the same 1) Tdis is on average four times larger here than on the square 
lattice. 

Also, nearly no difference can be seen between the exponents gained on 
triangular lattices with even and odd linear sizes. Amazingly, there is no 



Table 3. Critical exponents of the main characteristics of the line’s evolution pro- 
cess on a triangular lattice, obtained from a linear regression analysis of the log— log 
plots of the main quantities measured in the simulation (first row: even linear size 
1; second row: odd linecir size 1). The average confidence level of the regression is in 
all cases about 99.5 percent. 



1 vs. Tdu 


1 vs. SD{Tdu) 


^Isf VS. Tdia 


1 vs. Nuf 


0.25 


0.35 


0.70 


0.35 


0.25 


0.35 


0.71 


0.35 



essential difference between the critical exponents obtained from the sim- 
ulations on the triangular and square lattice. Though the geometry (e.g., 
coordination number, total number of bonds) and therefore the rules are 
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quite different, and the only common grounds are the applied BCs and the 
idea of inverting a cell, selected by a unit and a direction, there seems to 
be a general accordance between the evolution of the line on the lattices of 
apparently different type. Presumably, there is a chance to investigate the 
phenomenon analytically. 

As can be seen, for example from Table 3, only the first and the last char- 
acteristics are measured directly as well as independently from the computer 
experiment, but the remaining two characteristics can be easily inferred from 
them. 

4 General Considerations on the Usefulness 
and Possible Applications of the Model 

Because the suggested model appears to be purely kinetic, every realistic and 
properly chosen example may stand for its extension. This is due to the fact 
that by invoking some physical or related examples one must be aware of the 
existence of dynamic effects pertinent to them. Thus, the incorporation of 
interaction (dynamic) effects and/or possible energetic barriers is thought of 
to be mostly an extension of the concept under study. 

Let us sketch a number of general examples which are believed to suit the 
presented modelling. (Although they have been mostly designed for a square- 
lattice-like geometrical behaviour, they can also be related to geometries of 
other types, like for example, the triangular geometry.) These are as follows: 

• Heteropolymers: If one looks at Rules No*. 1-5, one may get the impres- 
sion that the system under consideration is a chemical reaction, repre- 
sented by 5 (in fact, 8) elementary sub-reactions, which are “perturbed” 
or somehow activated, but not controlled, by the diffusion field, so that 
one can roughly write down the reactions in the language of polymer sci- 
ence, respectively: 

Monomer Trimer, Dimer^ ^ Dimer'’^ , 

Dimer‘^^ ^ Dimer“^^ , Trimer'^ — ^ Monomer, 

Tetramer — ^ 0 — mer, 

(where the superscripts j and dj mean joint, and disjoint or very weakly 
joint mers, respectively, the prime denotes a complementary sub-config- 
uration, whereas the superscript a marks the line tension effect; 0 — mer 
means that the tetramer disappears while being picked up). The pre- 
sented reactions are always according to a scheme: odd {viz. monomer, 
trimer) into odd (conversely, but not quite) and/or even (dimer, tetramer, 
0— mer) into even (but not quite conversely, because of the irreversibility). 
In general, such a description may be a certain prerequisite of the Eigen- 
Prigogine-like complex scenario, with competing reactive molecules, cf. 
[9], where a kind of selection- mutation process (differentiation) occurs. 

• Elementary excitations of the condensed-matter (Frenkel’s excitons and 
polarons): If one assigns, for example to the X-unit an electron, and to 
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the F-unit a hole (or, a fonon) [6], one obtains a propagation of elemen- 
tary excitations in a 2d-superlattice, with e.g. biexcitons (or, bipolarons) 
as well as other (mostly, “short-living”) transients, i.e. a certain inclusion 
of really nonlinear effects provided by the Rules No. 1-5. A next step 
would be an investigation of the system with respect to some external 
influencing factor (strength of electromagnetic field) , which could eventu- 
ally lead to the determination of optical properties of a low dimensional 
semiconductor [10]. 

• Percolation-like phase transitions (localisation-delocalisation): Here we 
may think of the Mott or Anderson transitions for a metal-insulator sys- 
tem, where we have to start from a localised case, obeying an energetical 
criterion [11], and then we must decorrelate the system (e.g., thermally) 
or by introducing a structural disorder, which is more or less seen from 
our computer simulations, since we start with a straight line (an ordered 
object) and finally end up with a highly disordered structure. 

• Order-disorder phase changes (smooth vs. rough surface or interface): A 
straightforward example is the smooth-rough surface (interface) transi- 
tion, but seen in a more subtle way than usually the KPZ system does, 
or (related) the directed polymers or turbulent (Burgers) flows [12] can 
be seen. This can be attributed to the order-disorder phase transition, 
presumably of the Kosterlitz-Thouless type [5,13]. 

• Dislocations: The world of dislocations in condensed-matter systems man- 
ifests a variety of interesting behaviours. Similar to the case with excitons 
and polarons, during crystal growth, when the growing crystal’s surface 
advances, one may see many types of dislocations (e.g., of the Prank- Read 
type), but also some effect of mutual annihilation of dislocations with two 
inversely directed Burgers vectors [14], cf. Rule No. 5 or 4 (Krzysztof J. 
Kurzydlowski, private communication). 

5 Concluding Remarks 

The presented study aims at showing an interesting (subdiffusive) behaviour 
of a discretized line, evolving subject to a set of random rules by which the 
line-elements can be moved. The main results of our numerical study are as 
follows: 

• The greater the lattice is the larger are the mean disappearance time Tdis 
and its standard deviation 

• The results do not depend (almost!) upon whether we take a lattice of 
even or of odd linear size 

• There is some appreciable influence of the finiteness of the space: the 
smaller this finiteness is the more negligible the influence can be 

• Because the presented results are clearly obtained from the small-scale 
(see the lattice size) computer simulations as well as for a moderate num- 
ber of runs (50) for each Z, one should be cautious (see Tables 1-3) 
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• The results of simulation do not differ when looking into the line’s evolu- 
tion on the both different lattices; but they are different when a variation 
in the overall algorithm is considered (see, the second point or item of it 
as well as Table 2 and eq. (3)) 

It is Lutz Schimansky-Geier whose invention made it possible to look more 
carefully into the algorithm of the random line’s evolution. 
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Abstract. Two alternative theoretical approaches for the explanation of the ir- 
regular structure in the A and B ring of Saturn are presented; An oscillatory vis- 
cous instability and a model for gravitational scattering of the ring-matter at large 
(> 100m) ring-boulders. The former effect is based on a certain property of the 
transport of momentum in presence of Keplerian shear. The second process, in 
principle, represents a “fingerprint” of the size-distribution of the largest particles 
in the ring, caused by their gravitational action onto the population of smaller 
ring-particles. 



1 Introduction 

The cameras of the Voyager space-probes yielded a wealth of new informa- 
tion about planetary rings. These systems consist of stony or icy debris- 
particles which range in size from micrometer (dust) up to kilometer (moon- 
lets). Nearly all of the former knowledge about planetary rings had to be 
corrected after the analysis of the data of these space-crafts. 

One of the yet unexplained features are the so-called “irregular” structures 
in regions of high density of Saturn’s rings [6]. The Voyager imaging-sciences 
(ISS, [23]) and the occultation experiments (photo-polarimeter - PPS, [10], 
ultraviolet spectrometer - UVS, [4]) observed fluctuations of the density in 
the order of the mean density at radial scales from the limits of the resolution 
of the experiments (100m) up to a few hundred kilometers. The term “irreg- 
ular” structure unifies almost all density features seen in dense rings and it 
represents by far most of the area of the A and B ring of Saturn. A clear 
physical reason of these interesting features of the rings is not yet found. 

A first attempt to explain these structures had been the viscous instability 
[11,13,30]. Similar to the pressure instability in granular gases, where the 
decrease of pressure p with the density p causes the formation of clusters 
[17], a decreasing dynamic viscosity {rj = pv, kinematic viscosity ly) with the 
density, i.e. dp /dp < 0, leads to an amplification of density fluctuations. 
However, theoretical [1] as well as numerical studies [18, 19, 31] showed a 
growing dynamic viscosity with increasing density, mainly due to the influ- 
ence of the finite sizes of the ring particles on the transport processes in the 
rings. Taking into account the finite extent of colliding particles in presence 
of a force-gradient, which acts like a disruptive tidal force, clustering of par- 
ticles can only be sustained if attractive forces act during the collisions. In 
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the case of conditions representative for the dense rings of Saturn - the A 
and B ring - no clustering had been found in simulations. The concept of 
viscous instability does not work in explaining the irregular structure. 

Recently, an oscillatory instability had been suggested [22, 25] as another 
possibility which is also caused by viscous transports in presence of the Ke- 
plerian shear. In this paper we report on this effect in Section 3. 

Alternatively, Henon [8] proposed that big bodies in planetary rings, from 
100 m up to kilometers in size, could cause density features, recording in this 
way the upper part of the size-distribution of the ring-particles. Following 
this idea we performed Markov-chain models [27] in order to describe the 
gravitational scattering of the ring material by embedded moonlets to obtain 
the related structures. By analyzing the Voyager UVS occultation data we 
tried to find such theoretically predicted radial structures [26]. The major 
fiaws of these models had been the neglect of dissipative effects like viscous 
diffusion and the restriction to radial density features only. An extension of 
this model to viscous diffusion is presented in Section 4 of this report. 

In the next Section we present briefly the theoretical base for description of 
granular ensembles which is necessary for the following attempts in explaining 
the irregular structure in planetary rings. 

2 Basic Equations — Hydrodynamic Approximation 

The foundation of any theory of granular gases, for which the planetary rings 
are a prominent example, is kinetic theory. Thus, the Boltzmann equation, 
or in the case where the finite size of the particles is taken into account the 
Chapman-Enskog equation describe how such systems, once perturbed by 
external forces or steadily by the permanent Keplerian shear, approach their 
“quasi” -equilibrium [5]. The crucial term in these equations is the collision in- 
tegral which contains the information about collision frequency, the physical 
processes acting during the collision, and, most important for granular gases, 
the amount of mechanical energy dissipated in collisions [3, 24] . In the case 
of perfectly elastic colliding hard sphere-gases, the steady state distribution 
function fo can strictly be expressed by means of conservation of the particle 
number, momentum, and energy - yielding the famous Maxwellian velocity 
distribution. It seems to be plausible, that also the establishment of the equi- 
librium is then governed mainly by the time-evolution of these three physical 
values: momentum, energy, and mass. Then these balances result from the 
moments of the Boltzmann equation or the Chapman-Enskog equation and 
by closing the system in a proper way. The latter is achieved, if there are 
reasonable assumptions for connecting the fluxes of the state variables (en- 
ergy, momentum, mass) by their proper thermodynamic forces (temperature 
gradients, velocity shear, density gradients). 

In the following we consider a co-rotating frame, whose origin moves in 
a Keplerian circular orbit at a velocity rof?o, where tq and Oq oc 



are 
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the radial distance and the corresponding angular Keplerian velocity, respec- 
tively. Then, the balances of the surface-mass density cr = f dz p{r,ip, z), 
mean velocity u = (u), and the granular temperature T oc Tr{{v — u) o 
{v — u)) = characterize the evolution in a planetary ring. Here we have 
used ensemble averages and the velocity dispersion of the random walk of the 
particles is denoted by c^. Cylindrical coordinates r,ip, and z are used and 
we considered a thin ring where all values like density, pressure, transport 
coefficients are integrated in z-direction perpendicular to the ring plane. 

Assuming that the distribution function / does not deviate considerably 
from a Maxwellian, the system is described by the first three moments: 

= - V-P (1) 

(2) 

u - r. (3) 

r is the granular cooling, the term which expresses the main difference be- 
tween fluid dynamics and dynamics of granular media. In this paper, we 
choose for the mass of a particle m — 1. 

The gravitional field caused by the mass-distribution cr is denoted by # 
which must obey the Poisson equation 

V-V# = 47rGa6{z), (4) 

where G is the gravitational constant and 6{z) is Dirac’s delta-function. 

For the momentum flux - the stress tensor P - and the heat (energy) flux 
Q linear relations (Newtonian fluid) in terms of their thermodynamic forces 
V o It, and VT have been assumed: 



(T { ^ + 2f2o X It — SO^yey -I- /?qZ | 

da „ 

— = — aV • u 
dt 

^a^ = - V-Q - P : Vo 
2 dt 



P 



« — Pf-t- 2cri/D -b I i Q 

with ® ~ 5 o w -b u o V — 



= -kVP 



-V.ul 



( 5 ) 



The shear viscosity, the bulk viscosity and the heat conductivity are denoted 
by n, C, and k, respectively, where v is the crucial value for the transport 
of momentum and the related oscillatory instability as well as the Markov- 
model of the gravitational scattering in planetary rings. Analytical [1, 7] and 
numerical [18-20,31] studies yielded n = K{afao)^i^o, with vq oo CQ“/i?o = 
T°‘/f2o, P K 1 and a factor K. In the following, the ansatz 
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will be used for the theoretical analyses presented in the next Sections, where 
the values a « 1 and fa 5/4 have been obtained by numerical experiments 
[18-20]. For the pressure of the granular gas the relation p = aT has been 
chosen. 

The pre-factor K sa 1...100 covers a wide range of values due to the poor 
knowledge about the collision process, material properties, the broad distri- 
bution of sizes of the ring particles etc. For instance, particles of different 
sizes strongly affect the transport processes. The particle-size in planetary 
rings ranges from micrometer up to house-size or even kilometer-sized moon- 
lets (satellite Pan in the Encke-division of Saturn’s rings). In the size range 
between centimeters and 5 meters, a size distribution dN/dRp a , with 
7 «a 3, has been measured by Voyager radio-science experiments (RSS) [14]. 

In addition, the gravitational stirring of the ring-particles as well as the 
self-gravity may influence the velocity dispersion and the kinematic viscosity. 
All this results in a large uncertainty of the factor K . 

3 The Viscous Overstability 

The viscous overstability is an oscillatory instability of the shear flow, i.e. 
the hydrodynamic variables are subject to spatial and temporal oscillations 
with growing amplitude. The investigation of equations (1), (2), and (3) for 
linear stability yields a complex conjugate pair of eigenvalues whose real parts 
become positive when the exponent of the density dependence of the viscosity 
(6) exceeds a particular value which is given by properties of the particles 
and the flow itself. The corresponding exponential growth of the amplitudes 
is expected to saturate in the nonlinear regime. The importance of including 
the energy balance equation has been pointed out in [25]. For an isothermal 
model see [22]. 

We investigate the stability of a homogeneous unperturbed Keplerian flow 
which is perturbed by small fluctuations in all state variables. In this Sec- 
tion we deal with a small cubic box where its center is co-moving with the 
Keplerian circular motion, and furthermore, Cartesian coordinates x, y, z are 
used for this analysis. The r-coordinate points to the radial direction and 
the y axis is aligned with the orbital motion. The state variables are denoted 
by u, V, a and T and they measure small deviations of radial and tangential 
velocity as well as surface density and temperature from the ground state val- 
ues. The solutions of the linear problem subject to radial perturbations are 
of the form exp(st 4- ikx). The four eigenvalues are to be determined from 
a fourth order dispersion relation connecting s and k. For the self-gravity of 
the ring we take a solution of the Poisson equation [2] valid for a thin disk 
^{x,y,z = 0) = —2T:G<j{x,y)/\k\. This solution is obtained taking into ac- 
count that # has to fulfill the Laplace-equation for z ^ 0 and eq. (4) which 
is satisfied by the function ^ exp(st + ikx - \kz\). In order to get a 
relation between and the density in the k-space (Jk, the Poisson equation 
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(4) has to be integrated from ^ — a up to 2 : = a. Then the limit a -> 0 gives 

the thin disk solution given above (for details see [2]). 

For the collisional cooling we use T oc (l — e^) T [29] and for the kinematic 
shear viscosity the relation (6). The coefficient of restitution e measures the 
inelasticity of the collisions. For the heat conductivity and the bulk viscosity 
we take k/t] — 5, and C/i' = 1 (see [5] for dense hard sphere gases and [9] for 
the granular case). With these assumptions the stability diagrams of Fig. 1 
are obtained. We find two complex conjugate eigenvalues s with positive real 




A[m] 

Fig. 1. The overstable mode of the dispersion relation. Lines of equal 10-folding 
times of harmonic perturbations are shown in units of the orbital time in the (A,/3) 
plane. The isothermal case k/ti = 00 (dashed curves) and the non isothermal case 
k/t] = 5 (solid curves) are plotted. Neutral stability, separating in each case the 
overstable (above the line) and the stable region (below the line), is drawn as a 
bold line. 

part for values p, A above the neutral stability lines as indicated in Fig. 1, cor- 
responding to an oscillatory instability (overstability). The horizontal dotted 
line marks the value oi P = 5/4, as found in simulations [31]. The oscillatory 
instability is generally observed for A > 80m. The maximum growth-rates are 
obtained for A « 120m whereas they decrease to zero for A -t 00 . The main 
effect of the heat diffusion is to shift the stability boundary to higher values 
of P and to larger wavelengths A, indicated in the Figure by the dashed bold 
line and the solid bold line. The growth-rates in the overstable region are 
moderated. 
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4 Gravitational Scattering in Planetary Rings 

It was Henon’s [8] idea that the gravity of the largest bodies from 100m up 
to a few kilometer groove structures in the rings. Here we follow this idea 
by modeling the gravitational scattering by larger boulders in presence of 
viscous diffusion. We investigate the dependence of the shape and the length 
scales of ring-structures on the mass of the embedded body. The main goal 
of this work is to provide hints for the cameras of the Cassini Space-probe 
and point the attention to the question: Which structures can be expected 
to be caused by the largest particles in planetary rings? 

In order to describe the system, the whole area of the ring has been di- 
vided into two parts. The first one is the scattering region, approximated 
here to be a line located at the azimuthal longitude of the moonlet (p = 0. 
All results of the gravitational action of the moonlet on the ring particles 
are assumed to be concentrated on this line. This is a fairly acceptable ap- 
proximation as long as one deals with bodies of a diameter D « 0.1...10A:m. 
In this case the range of their gravitational influence, the Hill-sphere ra- 
dius h = tq {h/ [3(1 + « 2jD/ 3 (ro - radial distance moonlet-planet, 

= Mm/Mp - ratio between the masses of the moonlet and the planet), is 
of the order of the size of an icy moonlet itself - a negligible small distance 
compared to the whole circumference of the ring. 

For the rest of the ring it is assumed that the material moves at Keplerian 
orbits u = rf2{r) -I- Ur Br (0{r) - Keplerian orbit frequency, Ur - radial 
velocity), with \uTl{rO)\ 1. The viscous friction causes a small radial drift 
rUr(J = -Zdr{r'^ Oua) j {r Q) , resulting in a viscous diffusion [29]. With these 
assumptions, the conservation laws in both regions are expressed by the Eqs.: 



CO 

rQ{r) a{t,r,ip — ±G) = J dr' Si{r,r')r' n{r') a{t,r' ,ip = ^0) (7) 

0 

dtcr + (n - no)d^(7 - ^dr [(r fi)~^ dTir"^ Ova)\ = 0 . (8) 

The gravitational scattering (eq. (7)) is modeled as a Markov process, where 
the kernel a is the transition probability density of matter to be scattered 
from r' to r. This integral equation is approximated by a radial discretization 
resulting in a matrix equation. In order to get an expression for the scattering 
matrix corresponding to the kernel a(r, r'), the equations of motion of the 
restricted three-body problem (RTB-problem) have been integrated numeri- 
cally. A detailed description of calculating the scattering operator is given in 
[27]. Here we report just briefly the technique we have used. In order to de- 
rive the transition-probabilities, about 6.5 million test-particles are initially 
distributed homogeneously in the ring. The eccentricities (thermal velocities) 
have been chosen out of a distribution [15] dp{e) = (2ede/eg) exp[-e^/(co)], 
which corresponds to a stationary velocity dispersion of cq = 0.2 cm s~^ (or 
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Co w 10“^), a value obtained by numerical experiments [18, 19, 21]. Then, the 
changes of the orbital elements of the particles, caused by a single scattering 
process at the moonlets longitude, have been calculated [27] and then been 
used to derive the kernel a. 

The continuity equation (8) has been solved with a difference method, 
where the dominant motion - second term in eq. (8) - is just the differential 
rotation, and the third term represents the nonlinear viscous diffusion. 

We have used values which are adequate to the environment of Saturn’s 
B ring: Tq = 10^° cm, (Tq = 100 gcm~^, Qq ss 1.93 x 10~'^s“^, and u = 
The latter value corresponds to the viscosity of a ring of high 
optical thickness [18, 19]. Then, the evolution of the system has been followed 
by solving numerically Eqs. (7)-(8). 

A stationary state establishes as a result of the balance between creation 
of structures due to the gravitational scattering and their viscous dissipa- 
tion. Examples of typical structures are shown in Figure 2 where the station- 
ary density patterns are plotted. These patterns are caused by icy moonlets 
of sizes D = 200m (Fig. 2, top), and 2km (Fig. 2, bottom), respectively. 
According to this, two different types of structures, depending on the size 
(mass) of the embedded body, evolve: 1.) Density depletions which can not 
get around the whole circumference - giving the structure a “propeller-like” 
appearance (Fig.2, top); 2.) A gap, not necessarily empty, is formed in the 
whole ring (Fig. 2, bottom). 

For an estimate of the critical size of the moonlet, which separates both 
structural types, the time- and length scales of the competing processes - 
gravitational scattering and diffusion - are of importance. It is found that 
the radial scales of the moonlet- induced density depletions are about h<x 
for moonlets smaller than 2>km [16,26]. The synodic period for a distance h 
from the moonlet is tgyn{r) = 27r/(f?(r) — l?o) ^ 47rro/(3/2o^) which is the 
time the density features need to get around the whole circumference of the 
ring. 

The characteristic time for the competing process, the viscous diffusion, is 
« |zlrp/[3(l -t- /3)i^o]- The factor (1 + arises from the density depen- 
dence of i/{a) in eq. (2). This estimation just holds for small density gradients 
and if curvature terms can be neglected. 

Identifying the diffusion length with the radial extent of the moonlet-induced 
features I Ar] « /i and taking into account ~ [31?o/i/(2fo)] 

one obtains the azimuthal extent of the structures 

ipm oa [3(1 + P)vo]~^ ■ (9) 

Numerical results confirm this scaling relation fairly well [28]. 

The obtained features (Fig. 2) could serve as hints for the Cassini ex- 
periments to deduce the size and the distribution of larger bodies indirectly 
from the optical depth. Especially, the Cassini imaging sciences will be suit- 
able to recognize the structures related to large bodies. The radial scaling 
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Fig. 2. Top: Grey-level presentation of the stationary density of a ring with an 
embedded moonlet of a size D = 200 m showing the typical “propeller” structure. 
Bottom: The same for a moonlet of 2 kilometer in diameter resulting in a circum- 
planetary density depletion or gap. In both cases an initial optical depth r = 1 and 
a viscosity u — 10 cm^ s~^ have been chosen. The radial variable r = ro + hh is 
used. Note that this coordinate is enlarged by factor 10® and lO"* for the small - 
and the big moonlet, respectively. 



of the size of the moonlet-induced structures can be used to measure the 
size-distribution of the largest bodies. The azimuthal scaling then provides 
the possibility to probe properties of the granular matter surrounding the 
moonlet. In this way the viscosity as a function of density v{(j) might be 
estimated from the imaging data of the Cassini space-probe, provided that 
the size of the moonlet is known from the radial extent of the structures. 

5 Discussion 

We discussed two processes which both cause small scale signature of the 
density in planetary rings. 

The viscous overstability is mainly driven by the Keplerian shear, which is 
insofar the engine of the generation of the structure together with a certain 
functional dependence of the momentum transport on the density of the 
ring. If the kinematic viscosity u increases strongly enough with the density 
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(T, an interplay between inertia forces and viscous momentum transfer leads 
to oscillations with increasing amplitudes. The growth of the amplitudes is 
saturated by nonlinear effects. 

The second process is the gravitational scattering. As a result of the grav- 
itational action of the largest bodies in planetary rings a part of the irregular 
structures, showing certain shape, and with radial scales from 100m up to 
a few kilometers could be considered being a “fingerprint” of the tail of the 
size-distribution . 

Both eflFects act simultaneously and might be observed and distinguished 
by the experiments on-board the Cassini space-probe. 
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